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Introduction 


The new edition of my Advanced Engineering Mathematics with MATLAB is dramat- 
ically smaller than previous editions. The encyclopedic engineering mathematics tome is 
dead, killed by the student's ability to look up a particular topic on the Web. Because of 
time constraints in engineering curriculum, the mathematics instructor can select perhaps 
3 to 4 topics from the book, the most likely being ordinary differential equations, Laplace 
transforms, Fourier series, and separation of variables to solve one of the fundamental partial 
differential equations of mathematical physics. Sometimes Laplace transforms are replaced 
by linear algebra or vector calculus. 

To assist me in the choice of topics to include in this new edition, I reviewed the syllabi 
of various engineering mathematics courses that are taught at a wide variety of schools. 
There were a few who had courses that taught the Sturm-Liouville problem and special 
functions (Legendre and Bessel functions). They are included for completeness. 

Certain topics, such as z-transforms and complex variables, did not warrant (sadly) 
inclusion. Because many engineering students stil need this material, I have written a 
companion book, Advanced Engineering Mathematics: A Second Course, that still presents 
this material. 

The book begins with first- and higher-order ordinary differential equations, Chapters 
1 and 2, respectively. After some introductory remarks, Chapter 1 devotes itself to present- 
ing general methods for solving first-order ordinary differential equations. These methods 
include separation of variables, employing the properties of homogeneous, linear, and exact 
differential equations, and finding and using integrating factors. 

The reason most students study ordinary differential equations is for their use in ele- 
mentary physics, chemistry, and engineering courses. Because these differential equations 
contain constant coefficients, we focus on how to solve them in Chapter 2, along with 
a detailed analysis of the simple, damped, and forced harmonic oscillator. Furthermore, 
we include the commonly employed techniques of undetermined coefficients and variation 
of parameters for finding particular solutions. Finally, the special equation of Euler and 
Cauchy is included because of its use in solving partial differential equations in spherical 
coordinates. 


xvii 
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The next few chapters are given in arbitrary order because they require no additional 
knowledge beyond calculus and ordinary differential equations. Chapter 3 presents linear 
algebra as a method for solving systems of linear equations and includes such topics as 
matrices, determinants, Cramer's rule, and the solution of systems of ordinary differential 
equations via the classic eigenvalue problem. Vector calculus is presented in Chapter 4 
and focuses on the gradient operator as it applies to line integrals, surface integrals, the 
divergence theorem, and Stokes’ theorem. 

We now turn to a trio of chapters built off the concept of Fourier series. Fourier 
series allow us to reconstruct any arbitrary, well-behaved function defined over the interval 
(—L, L) in terms of cosines and sines. We then use this concept to solve ordinary differential 
equations, Section 5.6. Finally we show how these ideas may be applied when the functions 
is given as data points, Section 5.7. 

Fourier series are expanded to functions that are defined over the interval (—00,00) 
in Chapter 6. We then use Fourier integrals to find the particular solution for ordinary 
differential equations in Section 6.6. 

Having presented the general aspects of differential equations, we introduce in Chapter 
7 the technique of Laplace transforms. Derived from Fourier transforms when the function is 
defined over the interval [0, oo), this method allows us to solve initial-value problems where 
the forcing function turns “on” and “off.” Engineers use it extensively in their disciplines. 

'The reason why Fourier series are so important is their application in solving partial 
differential equations using separation of variables. We explore this topic using the pro- 
totypical wave equation (Section 8.3), heat equation (Section 9.3) and Laplace's equation 
(Section 10.3). We also investigate numerical solutions for each of these equations in Sec- 
tions 8.5, 9.5 and 10.5, respectively. Having taught the method of separation of variables 
using Fourier series, we expand the student's knowledge by generalizing Fourier series to 
eigenfunction expansions. Sections 11.1-11.3 explain how any piece-wise continuous func- 
tion can be re-expressed in an eigenfunction expansion using eigenfunctions from the classic 
Sturm-Liouville problem. Then separation of variables is retaught from this generalized 
viewpoint. 

We conclude the book by focusing on Bessel functions (Section 12.2) and Legendre 
polynomials (Section 12.1). These eigenfunctions appear in the solution of the wave, heat, 
and Laplace’s equations in cylindrical and spherical coordinates, respectively. 

MATLAB is still employed to reinforce the concepts that are taught. Of course, this 
book still continues my principle of including a wealth of examples from the scientific and 
engineering literature. Worked solutions are given in the back of the book. 
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Chapter 1 
First-Order Ordinary 
Differential Equations 


A differential equation is any equation that contains the derivatives or differentials of 
one or more dependent variables with respect to one or more independent variables. Because 
many of the known physical laws are expressed as differential equations, a sound knowledge 
of how to solve them is essential. In the next two chapters we present the fundamental 
methods for solving ordinary differential equations—a differential equation that contains 
only ordinary derivatives of one or more dependent variables. Later, we show in Section 7.7 
how Laplace transform methods can be used to solve ordinary differential equations, while 
systems of linear ordinary differential equations are treated in Section 3.6. Solutions for 
partial differential equations—a differential equation involving partial derivatives of one or 
more dependent variables of two or more independent variables—are given in Chapters 8, 
9, and 10. 


1.1 CLASSIFICATION OF DIFFERENTIAL EQUATIONS 
Differential equations are classified three ways: by type, order, and linearity. There 


are two types: ordinary and partial differential equations, which have already been defined. 
Examples of ordinary differential equations include 


dy 
— — 2y = 1.1.1 
ds; oy = (1.1.1) 
(x — y) dx + Ay dy = 0, (1.1.2) 
du | dv 
az AG =1+5z2, (1.1.3) 
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and 2 F 
y y À 
T2 T dr +y = sin(x). (1.1.4) 
On the other hand, examples of partial differential equations include 
ðu Ou 
—+ —=0 1.1.5 
a oret ( ) 
Ou Ou 
— — =2 1.1. 
Vx try ciu (1.1.6) 
and 


F2— = Ll. (1.1.7) 


In the examples that we have just given, we have explicitly written out the differ- 
entiation operation. However, from calculus we know that dy/dx can also be written y'. 
Similarly, the partial differentiation operator 04u/0x?0y? is sometimes written Urryy. We 
will also use this notation from time to time. 

The order of a differential equation is given by the highest-order derivative. For exam- 
ple, 

d3y 
dz? 


d? dy Ý . 
T | (2) y = sin(x) (1.1.8) 


is a third-order ordinary differential equation. Because we can rewrite 


(x + y)dy — x dz = 0 (1.1.9) 
as F 
Y 
(+y) =r (1.1.10) 


by dividing Equation 1.1.9 by dz, we have a first-order ordinary differential equation here. 
Finally 
tu o?u 
0x?0y? Ət? 
is an example of a fourth-order partial differential equation. In general, we can write an 
nth-order, ordinary differential equation as 


(1.1.11) 


dy d”y 
ye oS] 4. 1.1.12 
Fs e FE) =0 (1.1.12) 


The final classification is according to whether the differential equation is linear or 
nonlinear. A differential equation is linear if it can be written in the form: 


d” d"-1 d 
anla) + anala) imr) e + oley = f). (1.1.13) 


Note that the linear differential equation, Equation 1.1.13, has two properties: (1) The 
dependent variable y and all of its derivatives are of first degree (the power of each term 
involving y is 1). (2) Each coefficient depends only on the independent variable x. Examples 
of linear first-, second-, and third-order ordinary differential equations are 


(a + 1) dy — y dz — 0, (1.1.14) 
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y" + 3y' -2y =e", (1.1.15) 

and B , 
pim (x? +1) a +y = sin(x), (1.1.16) 

da? dx 


respectively. If the differential equation is not linear, then it is nonlinear. Examples of 
nonlinear first-, second-, and third-order ordinary differential equations are 


d 
Y cy ty? Zu (1.1.17) 
dx 
d? dy Y 
"m = (25 + 2zy = sin(z), (1.1.18) 
and 
yy" + 2y =e”, (1.1.19) 
respectively. 


At this point it is useful to highlight certain properties that all differential equations 
have in common regardless of their type, order, and whether they are linear or not. First, it 
is not obvious that just because we can write down a differential equation, a solution exists. 
The existence of a solution to a class of differential equations constitutes an important aspect 
of the theory of differential equations. Because we are interested in differential equations 
that arise from applications, their solution should exist. In Section 1.2 we address this 
question further. 

Quite often a differential equation has the solution y = 0, a trivial solution. For 
example, if f(a) = 0 in Equation 1.1.13, a quick check shows that y = 0 is a solution. 
Trivial solutions are generally of little value. 

Another important question is how many solutions does a differential equation have? 
In physical applications, uniqueness is not important because, if we are lucky enough to 
actually find a solution, then its ties to a physical problem usually suggest uniqueness. 
Nevertheless, the question of uniqueness is of considerable importance in the theory of 
differential equations. Uniqueness should not be confused with the fact that many solutions 
to ordinary differential equations contain arbitrary constants, much as indefinite integrals 
in integral calculus. A solution to a differential equation that has no arbitrary constants is 
called a particular solution. 


e Example 1.1.1 


Consider the differential equation 


dy 
— = 1 1) = 2. 1.1.20 
matth = y(t) ( ) 


This condition y(1) = 2 is called an initial condition and the differential equation plus the 
initial condition constitute an initial-value problem. Straightforward integration gives 


y(x) = fe +1)da+C =} +s +C. (1.1.21) 


Equation 1.1.21 is the general solution to the differential equation, Equation 1.1.20, because 
it is a solution to the differential equation for every choice of C. However, if we now satisfy 
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the initial condition y(1) = 2, we obtain a particular solution. This is done by substituting 
the corresponding values of x and y into Equation 1.1.21, or 


2=4(1)?+14+C=24+C, o C= (1.1.22) 


1 
2 B 
Therefore, the solution to the initial-value problem Equation 1.1.20 is the particular solution 


y(z) = (x + 1)?/2. (1.1.23) 


Finally, it must be admitted that most differential equations encountered in the “real” 
world cannot be written down either explicitly or implicitly. For example, the simple differ- 
ential equation y' — f(x) does not have an analytic solution unless you can integrate f(x). 
'This begs the question of why it is useful to learn analytic techniques for solving differential 
equations that often fail us. The answer lies in the fact that differential equations that we 
can solve share many of the same properties and characteristics of differential equations 
which we can only solve numerically. Therefore, by working with and examining the dif- 
ferential equations that we can solve exactly, we develop our intuition and understanding 
about those that we can only solve numerically. 


Problems 


Find the order and state whether the following ordinary differential equations are linear or 
nonlinear: 


1. y//y-z? tx 2. y —r-3 

3. sin(y’) = 5y 4. y" =y 

5. y! = 3x? 6. (y3) 21— 3y 

7. y" =y’ 8. y" — 4y' + 5y = sin(x) 

9. y" + zy = cos(y") 10. (2x + y) dx + (x — 3y) dy = 0 
11. (14 22 = (1 +y)? 12. yy" = z(y? +1) 

13. y -y- y? -zcre* 14. y" + cos(z)y' + y = 0 

15. z?y" + x1? (y) +y = e 16. y" + zy" +e! = r? 


1.2 SEPARATION OF VARIABLES 


'The simplest method of solving a first-order ordinary differential equation, if it works, is 
separation of variables. It has the advantage of handling both linear and nonlinear problems, 
especially autonomous equations.! From integral calculus, we already met this technique 
when we solved the first-order differential equation 


dy 
i = f(e). (1.2.1) 


1 An autonomous equation is a differential equation where the independent variable does not explicitly 


appear in the equation, such as y’ = f(y). 
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By multiplying both sides of Equation 1.2.1 by dz, we obtain 
dy = f(x) dz. (1.2.2) 


At this point we note that the left side of Equation 1.2.2 contains only y while the right 
side is purely a function of x. Hence, we can integrate directly and find that 


y= | fasc. (1.2.3) 


For this technique to work, we must be able to rewrite the differential equation so that all 
of the y dependence appears on one side of the equation while the z dependence is on the 
other. Finally, we must be able to carry out the integration on both sides of the equation. 

One of the interesting aspects of our analysis is the appearance of the arbitrary constant 
C in Equation 1.2.3. To evaluate this constant, we need more information. The most 
common method is to require that the dependent variable give a particular value for a 
particular value of x. Because the independent variable x often denotes time, this condition 
is usually called an initial condition, even in cases when the independent variable is not 
time. 


e Example 1.2.1 


Let us solve the ordinary differential equation 


d y 
PU eg ram (1.2.4) 
dr xy 
Because we can separate variables by rewriting Equation 1.2.4 as 
d 
ye "dy = n (1.2.5) 
x 
its solution is simply 
—ye™” — e™” = ln|er| +C (1.2.6) 
by direct integration. 
e Example 1.2.2 
Let us solve 
dy +y = re” (1.2.7) 
dx y = Te y, .2. 
subject to the initial condition y(0) — 1. 
Multiplying Equation 1.2.7 by dz, we find that 
dy + y dz = xe*y dz, (1.2.8) 


or 


dy = (xe? — 1) dz. (1.2.9) 
y 
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A quick check shows that the left side of Equation 1.2.9 contains only the dependent variable 
y while the right side depends solely on x and we have separated the variables onto one side 
or the other. Finally, integrating both sides of this equation, we have 


In(y) = ze — e — z +C. (1.2.10) 
Since y(0) = 1, C = 1 and 


y(x) = exp[(x — 1)e* +1 — x]. (1.2.11) 


In addition to the tried-and-true method of solving ordinary differential equations by 
hand, scientific computational packages such as MATLAB provide symbolic toolboxes that 
are designed to do the work for you. In the present case, typing: 
dsolve(’Dyty=x*exp(x)*y’,’?y(0)=1’,’x’) 
yields: 
ans = 
1/exp(-1) *exp (-x+x*exp (x) -exp (x) ) 
which is equivalent to Equation 1.2.11. 

Our success here should not be overly generalized. Sometimes these toolboxes give 
the answer in a rather obscure form or they fail completely. For example, in the previous 
example, MATLAB gives the answer: 
ans = 
-lambertw( (log (x)+C1)*exp(-1))-1 
The MATLAB function lambertw is Lambert’s W function, where w = lambertw(x) is the 


solution to we” = x. Using this definition, we can construct the solution as expressed in 
Equation 1.2.6. 


e Example 1.2.3 


Consider the nonlinear differential equation 


vy +y — 0. (1.2.12) 
Separating variables, we find that 
dy dz 1 1 x 
a i pe, Ż=—> +C = ; 1.2.1 
y^ z’ id y x P OE ell Cx-—1 ( 3) 


Equation 1.2.13 shows the wide variety of solutions possible for an ordinary differential 
equation. For example, if we require that y(0) — 0, then there are infinitely many different 
solutions satisfying this initial condition because C can take on any value. On the other 
hand, if we require that y(0) — 1, there is no solution because we cannot choose any constant 
C such that y(0) — 1. Finally, if we have the initial condition that y(1) — 2, then there is 
only one possible solution corresponding to C — 3. 

Consider now the trial solution y = 0. Does it satisfy Equation 1.2.12? Yes, it does. 
On the other hand, there is no choice of C that yields this solution. The solution y — 0 is 
called a singular solution to this equation. Singular solutions are solutions to a differential 
equation that cannot be obtained from a solution with arbitrary constants. 
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Figure 1.2.1: The solution to Equation 1.2.13 when C = —2,0,2,4. 


Finally, we illustrate Equation 1.2.13 using MATLAB. This is one of MATLAB’s strengths 
—the ability to convert an abstract equation into a concrete picture. Here the MATLAB 
Script: 
clear 
hold on 
x= 520.5253 
for c = -2:2:4 

y =x ./ (c*x-1); 
if (c== -2) subplot(2,2,1), plot(x,y,’*’) 

axis tight; title(’c = -2’); ylabel(’y’,’Fontsize’,20); end 

if (c== 0) subplot(2,2,2), plot(x,y,'^") 

axis tight; title(’c = 0’); end 

if (c== 2) subplot(2,2,3), plot(x,y,’s’) 
axis tight; title(’c = 2’); xlabel(’x’,’Fontsize’ ,20); 
ylabel(’y’,’Fontsize’,20); end 

if (c== 4) subplot(2,2,4), plot(x,y,’h’) 

axis tight; title(’c = 4’); xlabel(’x’,’Fontsize’,20); end 
end 


yields Figure 1.2.1, which illustrates Equation 1.2.13 when C = —2,0,2, and 4. 


'The previous example showed that first-order ordinary differential equations may have a 
unique solution, no solution, or many solutions. From a complete study? of these equations, 
we have the following theorem: 


? The proof of the existence and uniqueness of first-order ordinary differential equations is beyond the 
scope of this book. See Ince, E. L., 1956: Ordinary Differential Equations. Dover Publications, Inc., 
Chapter 3. 
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Theorem: Existence and Uniqueness 


Suppose some real-valued function f(x,y) is continuous on some rectangle in the xy- 
plane containing the point (a,b) in its interior. Then the initial-value problem 


dy 

x 
has at least one solution on the same open interval I containing the point x = a. Further- 
more, if the partial derivative Of /Oy is continuous on that rectangle, then the solution is 
unique on some (perhaps smaller) open interval Io containing the point x = a. 


e Example 1.2.4 


Consider the initial-value problem y' = 3y!/3/2 with y(0) = 1. Here f(a, y) = 3y!/?/2 
and fy = y 2/3 /2. Because fy is continuous over a small rectangle containing the point 
(0,1), there is a unique solution around z = 0, namely y = (x + 1)°/?, which satisfies the 
differential equation and the initial condition. On the other hand, if the initial condition 
reads y(0) = 0, then f, is not continuous on any rectangle containing the point (0,0) and 
there is no unique solution. For example, two solutions to this initial-value problem, valid 
on any open interval that includes x = 0, are yı (x) = z?/? and 


NU ue x21, 121 
vala) { 0, ql (2318) 


e Example 1.2.5: Hydrostatic equation 


Consider an atmosphere where its density varies only in the vertical direction. The 
pressure at the surface equals the weight per unit horizontal area of all of the air from sea 
level to outer space. As you move upward, the amount of air remaining above decreases 
and so does the pressure. This is why we experience pressure sensations in our ears when 
ascending or descending in an elevator or airplane. If we rise the small distance dz, there 
must be a corresponding small decrease in the pressure, dp. This pressure drop must equal 
the loss of weight in the column per unit area, —pg dz. Therefore, the pressure is governed 
by the differential equation 

dp — —pg dz, (1.2.16) 


commonly called the hydrostatic equation. 

To solve Equation 1.2.16, we must express p in terms of pressure. For example, in 
an isothermal atmosphere at constant temperature Ts, the ideal gas law gives p = pRT;, 
where R is the gas constant. Substituting this relationship into our differential equation 
and separating variables yields 


£ =- dz. (1.2.17) 


Integrating Equation 1.2.17 gives 


p(z) = p(0) exp(- k ) ; (1.2.18) 
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Thus, the pressure (and density) of an isothermal atmosphere decreases exponentially with 
height. In particular, it decreases by e^! over the distance RT,/g, the so-called “scale 
height." 


e Example 1.2.6: Terminal velocity 


As an object moves through a fluid, its viscosity resists the motion. Let us find the 
motion of a mass m as it falls toward the earth under the force of gravity when the drag 
varies as the square of the velocity. 

From Newton's second law, the equation of motion is 


m— = mg — Cpv?, (1.2.19) 


where v denotes the velocity, g is the gravitational acceleration, and Cp is the drag coeffi- 
cient. We choose the coordinate system so that a downward velocity is positive. 

Equation 1.2.19 can be solved using the technique of separation of variables if we change 
from time t as the independent variable to the distance traveled x from the point of release. 
'This modification yields the differential equation 


d 
mu— = mg — Cpv?, (1.2.20) 
dx 


since v = dx/dt. Separating the variables leads to 


v dv 
A say 1.2.21 
[omy e ( ) 
Or : 
k 
In (1 = -) = —3kz, (1.2.22) 
g 


where k = C p/m and v = 0 for x = 0. Taking the inverse of the natural logarithm, we 
finally obtain 


v(x) = 2 (1 e7"). (1.2.23) 


Thus, as the distance that the object falls increases, so does the velocity, and it eventually 
approaches a constant value 4/g/k, commonly known as the terminal velocity. 

Because the drag coefficient Cp varies with the superficial area of the object while 
the mass depends on the volume, k increases as an object becomes smaller, resulting in a 
smaller terminal velocity. Consequently, although a human being of normal size will acquire 
a terminal velocity of approximately 120 mph, a mouse, on the other hand, can fall any 
distance without injury. 


e Example 1.2.7: Interest rate 


Consider a bank account that has been set up to pay out a constant rate of P dollars 
per year for the purchase of a car. This account has the special feature that it pays an 
annual interest rate of r on the current balance. We would like to know the balance in the 
account at any time t. 
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Although financial transactions occur at regularly spaced intervals, an excellent ap- 
proximation can be obtained by treating the amount in the account x(t) as a continuous 
function of time governed by the equation 


x(t + At) = a(t) + rx (0) At — PAt, (1.2.24) 


where we have assumed that both the payment and interest are paid in time increments 
of At. As the time between payments tends to zero, we obtain the first-order ordinary 


differential equation 


d 
^ —-rz- P. (1.2.25) 


If we denote the initial deposit into this account by x(0), then at any subsequent time 
a(t) = z(0)e"* — P (e"* — 1) /r. (1.2.26) 


Although we could compute x(t) as a function of P, r, and z(0), there are only three 
separate cases that merit our close attention. If P/r > z(0), then the account will eventually 
equal zero at rt = In{P/ [P — rz(0)]]. On the other hand, if P/r < z(0), the amount 
of money in the account will grow without bound. Finally, the case z(0) = P/r is the 
equilibrium case where the amount of money paid out balances the growth of money due 
to interest so that the account always has the balance of P/r. 


e Example 1.2.8: Steady-state flow of heat 


When the inner and outer walls of a body, for example the inner and outer walls 
of a house, are maintained at different constant temperatures, heat will flow from the 
warmer wall to the colder one. When each surface parallel to a wall has attained a constant 
temperature, the flow of heat has reached a steady state. In a steady-state flow of heat, 
each surface parallel to a wall, because its temperature is now constant, is referred to as an 
isothermal surface. Isothermal surfaces at different distances from an interior wall will have 
different temperatures. In many cases the temperature of an isothermal surface is only a 
function of its distance x from the interior wall, and the rate of flow of heat Q in a unit 
time across such a surface is proportional both to the area A of the surface and to dT/dz, 
where T' is the temperature of the isothermal surface. Hence, 


dT 
= —KA— 1.2.27 
Q= -rA (1.2.27) 
where & is called the thermal conductivity of the material between the walls. 
In place of a flat wall, let us consider a hollow cylinder whose inner and outer surfaces 
are located at r = rı and r = r2, respectively. At steady state, Equation 1.2.27 becomes 


Q, = glee = Omi (1.2.28) 
dr dr 
assuming no heat generation within the cylindrical wall. 

We can find the temperature distribution inside the cylinder by solving Equation 1.2.28 
along with the appropriate conditions on T(r) at r = rı and r = r2 (the boundary condi- 
tions). To illustrate the wide choice of possible boundary conditions, let us require that the 
inner surface is maintained at the temperature Tı. We assume that along the outer surface, 
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heat is lost by convection to the environment, which has the temperature T,,. This heat 
loss is usually modeled by the equation 


dT 
K —— = —h(T — Ts), (1.2.29) 
dr 


r—T2 


where h > 0 is the convective heat transfer coefficient. Upon integrating Equation 1.2.28, 


Os 
2n&L 


T(r) = In(r) + C, (1.2.30) 
where Q, is also an unknown. Substituting Equation 1.2.30 into the boundary conditions, 
we obtain 


T(r) 2 Ti + xe In(ri/r), (1.2.31) 


with 
2n &L(Ti — Tx) 


k/r2 + hIn(ra/ri): 


Q, = (1.2.32) 
As r2 increases, the first term in the denominator of Equation 1.2.32 decreases while the 
second term increases. Therefore, Qy has its largest magnitude when the denominator is 
smallest, assuming a fixed numerator. This occurs at the critical radius rer = K/h, where 


2x &L(Ti — Tx) 
VEI ae See ee BM 1.2.33 
Qr 1+ In(rz./71) ( ) 


e Example 1.2.9: Population dynamics 


Consider a population P(t) that can change only by a birth or death but not by immi- 
gration or emigration. If B(t) and D(t) denote the number of births or deaths, respectively, 
as a function of time t, the birth rate and death rate (in births or deaths per unit time) is 


B(t-- At) - Bt) 1dB 


"bcm. P(t)At ~ P dt’ eae 
and 
do gy, BEEN nay 
Now, 
P'(t) = lim. EUER A) 220) (1.2.36) 
qu BC+ A0 - BO] - [DE + At) - DO) TI 
At—0 At 
= B'(t) — D'(t). (1.2.38) 
Therefore, 


P'(t) = [b(t) — dO PE). (1.2.39) 
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When the birth and death rates are constants, namely b and d, respectively, the pop- 
ulation evolves according to 


P(t) = P(0) exp[(b — d) t] . (1.2.40) 


e Example 1.2.10: Logistic equation 


'The study of population dynamics yields an important class of first-order, nonlinear, 
ordinary differential equations: the logistic equation. This equation arose in Pierre Francois 
Verhulst’s (1804-1849) study of animal populations. If x(t) denotes the number of species 
in the population and k is the (constant) environment capacity (the number of species that 
can simultaneously live in the geographical region), then the logistic or Verhulst's equation 
is 

x’ =ax(k—2)/k, (1.2.41) 


where a is the population growth rate for a small number of species. 
To solve Equation 1.2.41, we rewrite it as 


dx da x/k 
= — r dt. 1.2.42 
(1—z/k)r m ups s : ( ) 
Integration yields 
ln |x| — In |1 — z/k| = rt + In(C), (1.2.43) 
or 
cc sgir, (1.2.44) 
1—zx/k 
If z(0) = zo, 
k 
a(t) = ad (1.2.45) 


£o + (k — zo)e-"*' 


As t > oo, x (t) > k, the asymptotically stable solution. 


e Example 1.2.11: Chemical reactions 


Chemical reactions are often governed by first-order ordinary differential equations. 


For example, first-order reactions, which describe reactions of the form A E B, yield the 
differential equation 


1d[A] 
——-—— —k|A 1.2.46 
-T = [A] (1.2.46) 
where k is the rate at which the reaction is taking place. Because for every molecule of A 


that disappears one molecule of B is produced, a = 1 and Equation 1.2.46 becomes 


d|A] 


E s k[A]. (1.2.47) 


Integration of Equation 1.2.47 leads to 


-JẸ =i | dt. (1.2.48) 


3 Verhulst, P. F., 1838: Notice sur la loi que la population suit dans son accroissement. Correspond. 
Math. Phys., 10, 113-121. 


F'irst-Order Ordinary Differential Equations 13 


If we denote the initial value of [A] by [A]o, then integration yields 


—In[A] = kt — In (A],, (1.2.49) 


[A] = [A] e. (1.2.50) 


The exponential form of the solution suggests that there is a time constant 7, which is called 
the decay time of the reaction. This quantity gives the time required for the concentration 
of decrease by 1/e of its initial value [A],. It is given by 7 = 1/k. 

Turning to second-order reactions, there are two cases. The first is a reaction between 


two identical species: A + A Am products. The rate expression here is 
1 d|A] 2 
—-——  -—K|AJ.. 1.2.51 
2 = kA] (1.2.51) 
The second case is an overall second-order reaction between two unlike species, given by A 


+B 5 X. In this case, the reaction is first order in each of the reactants A and B and the 
rate expression is 


d| A 
zeal = k[A][B]. (1.2.52) 
dt 
Turning to Equation 1.2.51 first, we have by separation of variables 
[A] JIA t 
-f giel = 2x f dr, (1.2.53) 
[Alo [A] 0 
Or 
ed. UR cee (1.2.54) 
[A] [Ab l . 


Therefore, a plot of the inverse of A versus time will yield a straight line with slope equal 
to 2k and intercept 1/[A]p. 

With regard to Equation 1.2.52, because an increase in X must be at the expense 
of A and B, it is useful to express the rate equation in terms of the concentration of X, 
[X] = [A], — [A] = [B], — [B], where [A], and [B], are the initial concentrations. Then, this 
equation becomes 


TEL = k (Alo - [XD (Blo EX). (1.2.55) 
Separation of variables leads to 
[X] d£ 7 t 
JE C eE [ is lo 


'To integrate the left side, we rewrite the integral 


dE D dé dé 
/ (lA = 8 (Blo = € E (Alo — Bo (Blo - €) / Qucm em 


Carrying out the integration, 


1 nf IBlolATY _ 
a, "( ) kt. (1.2.58) 
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Again the reaction rate constant k can be found by plotting the data in the form of the left 
side of Equation 1.2.58 against t. 


Problems 
For Problems 1-9, solve the following ordinary differential equations by separation of vari- 


ables. Then use MATLAB to plot your solution. Try and find the symbolic solution using 
MATLAB’s dsolve. 


1. — = re” 2. (14-5?) dz — (1+ 27) dy = 0 3. In(z) — = xy 
dx dy 
2 2 
y^ dy 2 dy  2r-tzy dy 1/3 
do eh Le ORG AMEN HER a c= 
x dr T dr y+ xy di (xy) 
d d 
7. Z = erty g Y= (a? + 5)(y? +1) 9. z sin(y) 2 — sec(y) 
dx dx d. 


10. Solve the initial-value problem 


b 
— = — —— 0 => 
T ay + JP y(0) = yo: 


where a and b are constants. 
11. Setting u = y — x, solve the first-order ordinary differential equation 


dy y-t 


d£ x? uS 


12. Using the hydrostatic equation, show that the pressure within an atmosphere where 
the temperature decreases uniformly with height, T(z) = To — Tz, varies as 


To —ILz g/ (RT) 
sin (3525). 


where po is the pressure at z — 0. 


13. Using the hydrostatic equation, show that the pressure within an atmosphere with the 
temperature distribution 


|. jJ To- Ez, 0zzzH, 
On ee H € z, 
5 JRT) 
qu g 
iei: ! O<2<H, 
(2)=p = 
p — po 
i a da : g(z — H) n 
Tj "EI BURCH)? e 


where po is the pressure at z — 0. 
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14. The voltage V as a function of time t within an electrical circuit consisting of a 
capacitor with capacitance C and a diode in series is governed by the first-order ordinary 
differential equation 

dV V Vv? 

C——tut4u-—0 

d R S 
where R and S are positive constants. If the circuit initially has a voltage Vo at t = 0, find 
the voltage at subsequent times. 


15. A glow plug is an electrical element inside a reaction chamber, which either ignites the 
nearby fuel or warms the air in the chamber so that the ignition will occur more quickly. 
An accurate prediction of the wire's temperature is important in the design of the chamber. 

Assuming that heat convection and conduction are not important,” the temperature T' 
of the wire is governed by 


A=  B(T^ - T5) = P, 


where A equals the specific heat of the wire times its mass, B equals the product of the 
emissivity of the surrounding fluid times the wire's surface area times the Stefan-Boltzmann 
constant, Ta is the temperature of the surrounding fluid, and P is the power input. The 
temperature increases due to electrical resistance and is reduced by radiation to the sur- 
rounding fluid. 

Show that the temperature is given by 


epe C) rs 


where 74 = P/B + T? and Tp is the initial temperature of the wire. 


16. Let us denote the number of tumor cells by N(t). Then a widely used deterministic 


tumor growth law? is 

dN 

— — bN In( K/N 

N = dN In(K/N), 
where K is the largest tumor size and 1/b is the length of time required for the specific 
growth to decrease by 1/e. If the initial value of N(t) is N(0), find N(t) at any subsequent 
time t. 


17. The drop in laser intensity in the direction of propagation x due to one- and two-photon 
absorption in photosensitive glass is governed’ by 


— = -al — bP’, 


4 See Aiken, C. B., 1938: Theory of the diode voltmeter. Proc. IRE, 26, 859-876. 
5 See Clark, S. K., 1956: Heat-up time of wire glow plugs. Jet Propulsion, 26, 278-279. 
6 See Hanson, F. B., and C. Tier, 1982: A stochastic model of tumor growth. Math. Biosci., 61, 73-100. 


7 See Weitzman, P. S., and U. Ósterberg, 1996: Two-photon absorption and photoconductivity in 


photosensitive glasses. J. Appl. Phys., T9, 8648-8655. 
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where I is the laser intensity, a and 8 are the single-photon and two-photon coefficients, 
respectively. Show that the laser intensity distribution is 


ad (0)e-?* 
a + BI(0) (1 — e-e*)' 


I(x) = 
where 7(0) is the laser intensity at the entry point of the media, x = 0. 


18. The third-order reaction A + B + C 5 X is governed by the kinetics equation 


P = k (Als — [X] (Bl — [X]) (Clo — [X]) , 


where [A]o, [B]o, and [C]o denote the initial concentration of A, B, and C, respectively. Find 
how [X] varies with time t. 


ki 
19. The reversible reaction A c B is described by the kinetics equation? 
2 


dX] 

-u c Alo — K) — k2 (Blo + EX), 
where [X] denotes the increase in the concentration of B while [A]o and [B]o are the initial 
concentrations of A and B, respectively. Find [X] as a function of time t. Hint: Show that 
this differential equation can be written 


kı[A]o — ka [B]; 
ky + ks 


= (kı — k2) (a + [X]), a= 


1.3 HOMOGENEOUS EQUATIONS 
A homogeneous ordinary differential equation is a differential equation of the form 
M (z, y) dz + N(, y) dy = 0, (1.3.1) 


where both M (x, y) and N(z, y) are homogeneous functions of the same degree n. That 
means: M(tz,ty) = t"M(z,y) and N(ta,ty) = t"N(x,y). For example, the ordinary 
differential equation 
(x? + y?) dx + (a? — xy) dy = 0 (1.3.2) 

is a homogeneous equation because both coefficients are homogeneous functions of degree 
2: 

M(tz, ty) = Pa? + Py? = P? y?) = PM), (13.3) 
and 

N(ta, ty) = Px? — Pay = P (a? — zy) = PN (x,y). (1.3.4) 


8 See Küster, F. W., 1895: Ueber den Verlauf einer umkehrbaren Reaktion erster Ordnung in homogenem 
System. Z. Physik. Chem., 18, 171-179. 
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Why is it useful to recognize homogeneous ordinary differential equations? Let us set 
y — ux so that Equation 1.3.2 becomes 


(x? + u?2?) da + (x? — ux?) (u dz + z du) = 0. (1.3.5) 
Then, 
z?^(1-F u) dz + a?(1— u) du = 0, (1.3.6) 
l—-u dx 
d —=0 1.3.7 
ix, 4 p cU (1.3.7) 
or j : 
(4 + Es) du + Z =0. (1.3.8) 
lcu x 


Integrating Equation 1.3.8, 


u + 21n|1 + u| + In|z| = Injc|, (1.3.9) 
y y m 
Sue 2In|1 + J + In|z| = Inlel, (1.3.10) 
x x 
2 
in| EH ae, (1.3.11) 
cx x 
or 
(x + y = cae¥/*. (1.3.12) 
Problems 


First show that the following differential equations are homogeneous and then find their 
solution. Then use MATLAB to plot your solution. Try and find the symbolic solution using 
MATLAB’s dsolve. 


dy — dy — dy _ 2 2 
1. (+y -Uu 2: (+y) TTY 3. 2ry ys 5T ty) 
dy — dy — dy _ 2442 
4. w(x +y); — yz — v) 5; we TY t3vmy 6. way arty 
7. 7 = sec(y/x) + y/o 8. dy = eV/* + yg. 9. pul =z +y? 
dx dx dx 


1.4 EXACT EQUATIONS 
Consider the multivariable function z = f(x,y). Then the total derivative is 


of dx + of 


um Ox Oy 


dy = M(a,y) dz + N(a, y) dy. (1.4.1) 


If the solution to a first-order ordinary differential equation can be written as f(x,y) — c, 
then the corresponding differential equation is 


M (x, y) dz + N(z, y) dy = 0. (1.4.2) 
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How do we know if we have an exact equation, Equation 1.4.27 From the definition of 
M(x,y) and N(z, y), 
OM 0? f 9? f ON 
Oy OyOx  OxOy ðr’ 


if M(x,y) and N (z, y) and their first-order partial derivatives are continuous. Consequently, 
if we can show that our ordinary differential equation is exact, we can integrate 


(1.4.3) 


A —dMimg). wand " = N(x,y) (1.4.4) 
to find the solution f(x,y) = c. 
e Example 1.4.1 
Let us check and see if 
[y? cos(x) — 3a?y — 2a] dx + [2y sin(x) — z? + In(y)] dy = 0 (1.4.5) 


is exact. 
Since M(x,y) = y? cos(x) — 3z?y — 2, and N(z,y) = 2ysin(x) — z? + In(y), we find 
that 


OM 3 

a 2y cos(x) — 32", (1.4.6) 
and 5n 

—_ = =o 2 

TE 2y cos(x) — 3x. (1.4.7) 


Because N; = M}, Equation 1.4.5 is an exact equation. 


e Example 1.4.2 


Because Equation 1.4.5 is an exact equation, let us find its solution. Starting with 


o 
a = M(z,y) = y? cos(x) — 32?y — 2z, (1.4.8) 
z 
direct integration gives 
f(x,y) = y^ sin(x) — z?y — a^ + g(y). (1.4.9) 


Substituting Equation 1.4.9 into the equation fy = N, we obtain 


GL = aysin(a) = a? + g'(y) = 2ysinla) - 2° + Info). (1.4.10) 


Thus, g'(y) = In(y), or gly) = yln(y)— y + C. Therefore, the solution to the ordinary 
differential equation, Equation 1.4.5, is 


y? sin(x) — 2?y—2? + yln(y) — y = c. (1.4.11) 
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e Example 1.4.3 
Consider the differential equation 
(a+ y) dz + zln(x) dy =0 (1.4.12) 
on the interval (0,00). A quick check shows that Equation 1.4.12 is not exact since 


zd zd and 2 =1+4In(z). (1.4.13) 
Oy Ox 


However, if we multiply Equation 1.4.12 by 1/z so that it becomes 
(1 + 3 dx + ln(x) dy = 0, (1.4.14) 
x 


then this modified differential equation is exact because 


OM 1 ON 1 
SSS d poe. 1.4.15 
Oy xr’ ix Ór zxr ( ) 
Therefore, the solution to Equation 1.4.12 is 
z +yln(z) = C. (1.4.16) 


This mysterious function that converts an inexact differential equation into an exact one is 
called an integrating factor. Unfortunately there is no general rule for finding one unless 
the equation is linear. 


Problems 


Show that the following equations are exact. Then solve them, using MATLAB to plot them. 
Finally, try and find the symbolic solution using MATLAB's dsolve. 


1. 2eyy! = x? — y? 2. (a+y)y +y=2 
3. (y? — 1) dz + [2zy — sin(y)] dy = 0 4. [sin(y) — 2zy + x7] dx 

+[x cos(y) — z?] dy = 0 
5. —ydz/z? + (1/z + 1/y) dy = 0 6. (3x? — 6zy) dz — (32? + 2y) dy = 0 
7. ysin(zy) dz + z sin(xy) dy = 0 8. (2zy? + 3x7) dx + 22?y dy = 0 
9. (2zy? + 5x ^y) dx 10. (x? + y/z) dz + [y? + In(z)] dy = 0 


+(327y? + 2° + 1)dy = 0 


11. [x c e^" + x ln(y)] dy 12. cos(4y?) dz — 8xry sin(4y?) dy = 0 
+[yIn(y) + e*] dz = 0 


13. sin?(z + y) dz — cos? (x + y) dy = 0 14. cos(4y?) dz — 8xry sin(4y?) dy = 0 
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15. Show that the integrating factor for (x — y)y' + ay(1— y) = 0 is u(y) = y*/(1— y)**?, 
a+ 1 — 1/a. Then show that the solution is 


a+1 y gotl » 
"uten ] acq t 


1.5 LINEAR EQUATIONS 


In the case of first-order ordinary differential equations, any differential equation of the 


form F 
ay(x) + ao(x)y = f(a) (1.5.1) 
is said to be linear. 


Consider now the linear ordinary differential equation 


d 
T —4y = 2%e* (1.5.2) 
= dy 4 
ae —y Pet. (1.5.3) 
dr x 


Let us now multiply Equation 1.5.3 by 2~*. (How we knew that it should be 2~* and not 
something else will be addressed shortly.) This magical factor is called an integrating factor 
because Equation 1.5.3 can be rewritten 


—A3. ey UE", (1.5.4) 


it - ) = xe". (1.5.5) 


Thus, our introduction of the integrating factor z-^ allows us to use the differentiation 
product rule in reverse and collapse the right side of Equation 1.5.4 into a single x derivative 
of a function of x times y. If we had selected the incorrect integrating factor, the right side 
would not have collapsed into this useful form. 

With Equation 1.5.5, we may integrate both sides and find that 


a = n dz 4- C, (1.5.6) 
ki 
or 
E = (x — 1)e* +C, (1.5.7) 
or 
y = zf (x — 1)e* + Cat. (1.5.8) 


From this example, it is clear that finding the integrating factor is crucial to solving 
first-order, linear, ordinary differential equations. To do this, let us first rewrite Equation 
1.5.1 by dividing through by a1(x) so that it becomes 


— + P(z)y = Q(x), (1.5.9) 
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or 
dy + [P(x)y — Q(x)| dz = 0. (1.5.10) 


If we denote the integrating factor by u(x), then 
u(z)dy + u(z)[P(z)y — QGx)] dz = 0. (1.5.11) 


Clearly, we can solve Equation 1.5.11 by direct integration if it is an exact equation. If this 
is true, then 


Fe = 5 MEPE- QUID (1.5.12) 
» = p(x) P(x), and M = P(x) da. (1.5.13) 

Integrating Equation 1.5.13, 
u(x) = exp Ea P(E) a : (1.5.14) 


Note that we do not need a constant of integration in Equation 1.5.14 because Equation 
1.5.11 is unaffected by a constant multiple. It is also interesting that the integrating factor 
only depends on P(x) and not Q(z). 

We can summarize our findings in the following theorem. 


Theorem: Linear First-Order Equation 


If the functions P(x) and Q(x) are continuous on the open interval I containing the 
point zo, then the initial-value problem 


has a unique solution y(x) on I, given by 


C 1 T 
(a) = C uu / QuE) de 


with an appropriate value of C, and u(x) is defined by Equation 1.5.14. 


'The procedure for implementing this theorem is as follows: 

e Step 1: If necessary, divide the differential equation by the coefficient of dy/dx. This 
gives an equation of the form Equation 1.5.9 and we can find P(a) by inspection. 

e Step 2: Find the integrating factor by Equation 1.5.14. 

e Step 3: Multiply the equation created in Step 1 by the integrating factor. 


e Step 4: Run the derivative product rule in reverse, collapsing the left side of the 
differential equation into the form d[u(x)y]/dx. If you are unable to do this, you have 
made a mistake. 


e Step 5: Integrate both sides of the differential equation to find the solution. 
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'The following examples illustrate the technique. 
e Example 1.5.1 
Let us solve the linear, first-order ordinary differential equation 
zy — y = 4r ln(x). (1.5.15) 


We begin by dividing through by x to convert Equation 1.5.15 into its canonical form. 
This yields 


1 
y — —y = Aln(z). (1.5.16) 
x 


From Equation 1.5.16, we see that P(x) = 1/x. Consequently, from Equation 1.5.14, we 


have that "S "s e a] ET. (- f 3 A (1.5.17) 
: : 5. 


Multiplying Equation 1.5.16 by the integrating factor, we find that 


y y _ 4ln(z) 


1.5.18 
r x2 zo! (1:5218) 
i d 4ln(z) 
J n(x 
= 2 1.5.19 
dx G T (Eo) 
Integrating both sides of Equation 1.5.19, 
I 
w= af e — 21n?(z) 4- C. (1.5.20) 
x x 
Multiplying Equation 1.5.20 through by x yields the general solution 
y = 2x ln? (£) + Cz. (1.5.21) 


Although it is nice to have a closed-form solution, considerable insight can be gained 
by graphing the solution for a wide variety of initial conditions. To illustrate this, consider 
the MATLAB script: 


clear 
^4 use symbolic toolbox to solve Equation 1.5.15 
y = dsolve(’x*Dy-y=4*x*log(x)’,’y(1) = c’,’x’); 
^4 take the symbolic version of the solution 
4 and convert it into executable code 
solution = inline(vectorize(y),’x’,’c’); 
close all; axes; hold on 
^4 now plot the solution for a wide variety of initial conditions 
x = 0.1:0.1:2; 
for c = -2:4 
if (c==-2) plot(x,solution(x,c),’. 
if (c==-1) plot(x,solution(x,c), 


>); end 
20’); 

if (c== 0) plot(x,solution(x,c),’x’); end 
24 ); 
x? ); 


end 


if (c== 1) plot(x,solution(x,c),?+?); end 


if (c== 2) plot(x,solution(x,c), end 
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Figure 1.5.1: The solution to Equation 1.5.15 when the initial condition is y(1) — c. 


if (c== 3) plot(x,solution(x,c),’s’); end 

if (c== 4) plot(x,solution(x,c),’d’); end 
end 
axis tight 
xlabel(C?x?,?Fontsize?,20); ylabel(’y’,’Fontsize’ ,20) 
legend(’c = -2’?,’c = -1’,’c = 0’,’c = 1’,... 

?¢ = 2’,’c = 3’,’c = 4’); legend boxoff 

This script does two things. First, it uses MATLAB’s symbolic toolbox to solve Equa- 
tion 1.5.15. Alternatively, we could have used Equation 1.5.21 and introduced it as a 
function. The second portion of this script plots this solution for y(1) = C where C = 
—2,—1,0,1,2,3,4. Figure 1.5.1 shows the results. As xr — 0, we note how all of the 
solutions behave like 27 In? (a). 


e Example 1.5.2 


Let us solve the first-order ordinary differential equation 


d esci 
dx y-2 


(1.5.22) 


subject to the initial condition y(2) = 6. 
Beginning as before, we rewrite Equation 1.5.22 in the canonical form 


(y — z)y' - y — 0. (1.5.23) 


Examining Equation 1.5.23 more closely, we see that it is a nonlinear equation in y. On the 
other hand, if we treat x as the dependent variable and y as the independent variable, we 
can write Equation 1.5.23 as the linear equation 
dx 

+ 


A (1.5.24) 
dy y 


Proceeding as before, we have that P(y) = 1/y and p(y) = y, so that Equation 1.5.24 
can be rewritten 


a, (uz) =y (1.5.25) 
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Figure 1.5.2: Schematic diagram for an electric circuit that contains a resistor of resistance R and an 


inductor of inductance L. 


or 
yx = sy +C. (1.5.26) 


Introducing the initial condition, we find that C = —6. Solving for y, we obtain 


y=ut Va? 412. (1.5.27) 


We must take the positive sign in order that y(2) = 6 and 


y=aut+ Va? +12. (1.5.28) 


e Example 1.5.3: Electric circuits 


A rich source of first-order differential equations is the analysis of simple electrical 
circuits. These electrical circuits are constructed from three fundamental components: the 
resistor, the inductor, and the capacitor. Each of these devices gives the following voltage 
drop: In the case of a resistor, the voltage drop equals the product of the resistance R 
times the current J. For the inductor, the voltage drop is L dI/dt, where L is called the 
inductance, while the voltage drop for a capacitor equals Q/C, where Q is the instantaneous 
charge and C is called the capacitance. 

How are these voltage drops applied to mathematically describe an electrical circuit? 
This question leads to one of the fundamental laws in physics, Kirchhoff’s law: The 
algebraic sum of all the voltage drops around an electric loop or circuit is zero. 

To illustrate Kirchhoff’s law, consider the electrical circuit shown in Figure 1.5.2. By 
Kirchhoff's law, the electromotive force E, provided by a battery, for example, equals the 
sum of the voltage drops across the resistor RI and L dI/dt. Thus the (differential) equation 


that governs this circuit is 


dI 
La +RI=E. (1.5.29) 


Assuming that E, J, and R are constant, we can rewrite Equation 1.5.29 as 


d [ pest JOE nu 
Zle i(o = Lem. (1.5.30) 


Integrating both sides of Equation 1.5.30, 


eRUL T(¢) = peril + Ci, (1.5.31) 
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| - 
1 2 3 RIL 


Figure 1.5.3: The temporal evolution of current I(t) inside an electrical circuit shown in Figure 1.5.2 with 
a constant electromotive force E. 


Or 
E 
Tres us Cue e (1.5.32) 


To determine Ci, we apply the initial condition. Because the circuit is initially dead, 
I(0) = 0, and 


I(t) = A (1 - e REL) i (1.5.33) 


Figure 1.5.3 illustrates Equation 1.5.33 as a function of time. Initially the current increases 
rapidly but the growth slows with time. Note that we could also have solved this problem 
by separation of variables. 

Quite often, the solution is separated into two parts: the steady-state solution and the 
transient solution. The steady-state solution is that portion of the solution which remains 
as t — oo. It can equal zero. Presently it equals the constant value, E/R. The transient 
solution is that portion of the solution which vanishes as time increases. Here it equals 
-Eet L/R. 

Although our analysis is a useful approximation to the real world, a more realistic one 
would include the nonlinear properties of the resistor.? To illustrate this, consider the case 
of an RL circuit without any electromotive source (E = 0) where the initial value for the 
current is Jo. Equation 1.5.29 now reads 


LO +RI(1—al)=0, 1(0) — Io. (1.5.34) 


Separating the variables, 


dI dI dI R 
= = dt. 1.5.35 
fara). I-la I L ( ) 


Upon integrating and applying the initial condition, we have that 


Ige- RHE 


[= ; 
1 — alo + alge- Ft/L 


(1.5.36) 


9 For the analysis of 
dl B 
Li + RI + KI” =0, 


see Fairweather, A., and J. Ingham, 1941: Subsidence transients in circuits containing a non-linear resistor, 
with reference to the problem of spark-quenching. J. IEE, Part 1, 88, 330-339. 
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Figure 1.5.4: The variation of current I/Io as a function of time Rt/L with different values of alo. 


Figure 1.5.4 shows I(t) for various values of a. As the nonlinearity reduces resistance, 
the decay in the current is reduced. If alọ > 1, Equation 1.5.36 predicts that the current 
would grow with time. The point here is that nonlinearity can have a dramatic influence 
on a physical system. 

Consider now the electrical circuit shown in Figure 1.5.5, which contains a resistor with 
resistance R and a capacitor with capacitance C. Here the voltage drop across the resistor 
is still RI while the voltage drop across the capacitor is Q/C. Therefore, by Kirchhoff's 
law 

Q 


[uc LcoBr 1.5.37 
RI + C ( ) 


Equation 1.5.37 is not a differential equation. However, because current is the time rate of 
change in charge I = dQ/dt, our differential equation becomes 


, 


R= +Ž =F, (1.5.38) 


which is the differential equation for the instantaneous charge. 
Let us solve Equation 1.5.38 when the resistance and capacitance are constant but the 
electromotive force equals Eo cos(wt). The corresponding differential equation is now 


R + 2 = Eo cos(wt). (1.5.39) 


The differential equation has the integrating factor e'/(*C) so that it can be rewritten 


d | (RC) — Eo t/RC) 
I le Qo) = Pet! RO) cos(wt). (1.5.40) 
Integrating Equation 1.5.40, 
CE 
RC 0 RC " é 
et/( Q(t) = Tmo ) [cos(wt) + RCw sin(wt)] + Ci (1.5.41) 
or CE 
Q(t) 2 [eos(wt) + RCw sin(wt)] + C1e- (RO), (1.5.42) 


= 14 R2C2w2 
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Figure 1.5.5: Schematic diagram for an electric circuit that contains a resistor of resistance R and a 
capacitor of capacitance C. 


If we take the initial condition as Q(0) — 0, then the final solution is 


C Eo 


QU- mox [cos (wt) — e MRO) 4 RCwsin(wt)| . (1.5.43) 
Figure 1.5.6 illustrates Equation 1.5.43. Note how the circuit eventually supports a purely 
oscillatory solution (the steady-state solution) as the exponential term decays to zero (the 
transient solution). Indeed, the purpose of the transient solution is to allow the system to 


adjust from its initial condition to the final steady state. 


e Example 1.5.4: Terminal velocity 


When an object passes through a fluid, the viscosity of the fluid resists the motion by 
exerting a force on the object proportional to its velocity. Let us find the motion of a mass 
m that is initially thrown upward with the speed vo. 

If we choose the coordinate system so that it increases in the vertical direction, then 
the equation of motion is 


m— = —kv — mg (1.5.44) 


with v(0) — vo and k » 0. Rewriting Equation 1.5.44, we obtain the first-order linear 
differential equation 


dv k 
—+—v=-—4g. 1.5.45 
CE EE ( ) 
Its solution in nondimensional form is 
kv(t k 
Jo a ee | (1+ 2) p (1.5.46) 
mg mg 


'The displacement from its initial position is 


2 2 
kalt) _ kêzo kt, (: | =) (1 a, (1.5.47) 


mg mg m mg 


As t — oo, the velocity tends to a constant downward value, —mg/k, the so-called “terminal 
velocity,” where the aerodynamic drag balances the gravitational acceleration. This is the 
steady-state solution. 

Why have we written Equation 1.5.46 and Equation 1.5.47 in this nondimensional 
form? There are two reasons. First, the solution reduces to three fundamental variables, 
a nondimensional displacement x, = k?z(t)/(m?g), velocity v, = kv(t)/(mg), and time 
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NONDIMENSIONAL CHARGE 
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Figure 1.5.6: The temporal evolution of the nondimensional charge (1 + R?C?w?)Q(t) /(CEo) in the 
electric circuit shown in Figure 1.5.4 as a function of nondimensional time wt when the circuit is driven by 
the electromotive force Eo cos(wt) and RCw = 2. 


t, = kt/m, rather than the six original parameters and variables: g, k, m, t, v, and z. 
Indeed, if we had substituted t,, v., and x, into Equation 1.5.45, we would have obtained 
the following simplified initial-value problem: 


k2 
EE a P T i t0 


1.5.48 
dt. mg mg ( ) 


right from the start. The second advantage of the nondimensional form is the compact 
manner in which the results can be displayed, as Figure 1.5.7 shows. 

From Equation 1.5.46 and Equation 1.5.47, the trajectory of the ball is as follows: If 
we define the coordinate system so that ro = 0, then the object will initially rise to the 


height H given by 
kH k k 
USD in(1 2) (1.5.49) 


mg mg 


at the time 


ktmaz k 
= m(1 + 2) l (1.5.50) 
m mg 


when v(tmar) = 0. It will then fall toward the earth. Given sufficient time kt/m > 1, it 
would achieve terminal velocity. 


e Example 1.5.5: The Bernoulli equation 


Bernoulli's equation, 


d 
» +p(x)y = q(£)y”, n#0,1, (1.5.51) 


is a first-order, nonlinear differential equation. This equation can be transformed into a 


first-order, linear differential equation by introducing the change of variable z = y!~”. 


Because F d 
z -n 4Y 
= (1 
a= ny” T 


(1.5.52) 
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Figure 1.5.7: The nondimensional displacement k?a(t)/(m?g) as a function of nondimensional time kt/m 
of an object of mass m thrown upward at the initial nondimensional speed v = kvo/(mg) in a fluid that 
retards its motion as —kv. 


the transformed Bernoulli equation becomes 


& + (1=n)p(a)z = (1 — n)a(z). (1.5.53) 


This is now a first-order linear differential equation for z and can be solved using the 
methods introduced in this section. Once z is known, the solution is found by transforming 
back from z to y. 

To illustrate this procedure, consider the nonlinear ordinary differential equation 


d 
ry 2 — gy? — 1, (1.5.54) 
dx 
or , $ 
Yy v WV 
—— Luc. 1.5.55 
dr c x? ( ) 
Equation 1.5.55 is a Bernoulli equation with p(x) = —1/z, q(x) = 1/z?, and n = —1. 
Introducing z = y?, it becomes 
dz 2z 2 (1.5.56) 
dr xz x n 


This first-order linear differential equation has the integrating factor u(x) = 1/z? and 


d/z 2 

—[—]---. 1.5.57 

da: o ) x4 ( ) 
Integration gives 

z 2 

——C-—-x. 1.5.58 

x? 323 ( ) 
Therefore, the general solution is 

2 
y =2= 027 — =. (1.5.59) 
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Problems 


Find the solution for the following differential equations. State the interval on which the 
general solution is valid. Then use MATLAB to examine their behavior for a wide class of 
initial conditions. 


l.y-y-e* 2. y +2ry — x 

3. xy’ +ay=1 4. (2y + x?) dz = z dy 

5. y! — 3y/x = 22? 6. y' + 2y = 2sin(z) 

T. y' +2cos(2x)y = 0 8. zy' +y = ln(x) 

9. y +3y=4, y(0)=5 10. y — y — e*/z, yle)=0 

11. sin(z)y' + cos(x)y = 1 12. [1 — cos(z)]y' + 2sin(z)y = tan(x) 


13. y’ + [atan(z) + bsec(x)]y = csec(x) 14. (zy - y — 1) dz + zdy —0 


x  sin(2uzx) rtl 


2k 
15. y + 2ay = y(0) = 0. 16. y + mE »( 


k 1) 2-0. 
5 A S ) » 0, y(1) 20 


17. Solve the following initial-value problem: 


kay! y? a, y(1) — 0. 
dx 


Hint: Introduce the new dependent variable p = y?. 


18. If x(t) denotes the equity capital of a company, then under certain assumptions!? x(t) 
is governed by 


where N is the dividend payout ratio, r is the rate of return of equity, and S is the rate of 
net new stock financing. If the initial value of x(t) is x(0), find z(t). 


19. The assimilation! of a drug into a body can be modeled by the chemical reaction A a 
B5 C, which is governed by the chemical kinetics equations 
d|A] dB] 


up 7 TAL © p= Al - eB), 


dic] 
—— = k9|B 

dt 2l Ls 
where [A] denotes the concentration of the drug in the gastrointestinal tract or in the site 
of injection, [B] is the concentration of the drug in the body, and [C] is either the amount 
of drug eliminated by various metabolic functions or the amount of the drug utilized by 


10 See Lebowitz, J. L., C. O. Lee, and P. B. Linhart, 1976: Some effects of inflation on a firm with 
original cost depreciation. Bell J. Economics, 7, 463—477. 


11 See Calder, G. V., 1974: The time evolution of drugs in the body: An application of the principle of 
chemical kinetics. J. Chem. Educ., 51, 19-22. 
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various action sites in the body. If [A]g denotes the initial concentration of A, find [A], [B], 
and [C] as a function of time t. 


20. Find the current in an RL circuit when the electromotive source equals Eo cos?(uwt). 
Initially the circuit is dead. 


Find the general solution for the following Bernoulli equations: 


2 dy 


dy y 2 2 — o 

9]. pe emv 22. = 23. a 
dx x y EACUS RE) : d£ x wy 
d d dy 

24, B L9 Ley? 25. 2xy Y y.r-0 26. x y y= lay? 
dr zc dx da 


1.6 GRAPHICAL SOLUTIONS 


In spite of the many techniques developed for their solution, many ordinary differen- 
tial equations cannot be solved analytically. In the next two sections, we highlight two 
alternative methods when analytical methods fail. Graphical methods seek to understand 
the nature of the solution by examining the differential equations at various points and 
infer the complete solution from these results. In the last section, we highlight the numeri- 
cal techniques that are now commonly used to solve ordinary differential equations on the 
computer. 


e Direction fields 


One of the simplest numerical methods for solving first-order ordinary differential equa- 
tions follows from the fundamental concept that the derivative gives the slope of a straight 
line that is tangent to a curve at a given point. 

Consider the first-order differential equation 


y = f(z,y), (1.6.1) 


which has the initial value y(xo) = yo. For any (x,y) it is possible to draw a short line 
segment whose slope equals f(x, y). This graphical representation is known as the direction 
field or slope field of Equation 1.6.1. Starting with the initial point (ao, yo), we can then 
construct the solution curve by extending the initial line segment in such a manner that 
the tangent of the solution curve parallels the direction field at each point through which 
the curve passes. 

Before the days of computers, it was common to first draw lines of constant slope 
(isoclines) or f(x,y) — c. Because along any isocline all of the line segments had the same 
slope, considerable computational savings were realized. Today, computer software exists 
that performs these graphical computations with great speed. 

To illustrate this technique, consider the ordinary differential equation 


d 
a =r- t. (1.6.2) 
Its exact solution is 

a(t) = Ce -- t? + 2¢ + 2, (1.6.3) 


where C is an arbitrary constant. Using the MATLAB script: 
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Figure 1.6.1: The direction field for Equation 1.6.2. The solid lines are plots of the solution with various 
initial conditions. 


clear 
^4 create grid points in t and x 
[t,x] = meshgrid(-2:0.2:3,-1:0.2:2); 
% load in the slope 
slope = x - t.*t; 
^ find the length of the vector (1,slope) 
length = sqrt(1 + slope .* slope); 
^4 create and plot the vector arrows 
quiver(t,x,1./length,slope./length,0.5) 
axis equal tight 
hold on 
^4 plot the exact solution for various initial conditions 
tt = [-2:0.2:3]; 
for cval - -10:1:10 
x.exact = cval * exp(tt) + tt.*tt + 2*tt + 2; 
plot(tt,x exact) 
xlabel(’t’,’Fontsize’ ,20) 
ylabel(’x’,’Fontsize’ ,20) 
end 


we show in Figure 1.6.1 the directional field associated with Equation 1.6.2 along with 
some of the particular solutions. Clearly the vectors are parallel to the various particular 
solutions. Therefore, without knowing the solution, we could choose an arbitrary initial 
condition and sketch its behavior at subsequent times. The same holds true for nonlinear 
equations. 


e Rest points and autonomous equations 
In the case of autonomous differential equations (equations where the independent 
variable does not explicitly appear in the equation), considerable information can be gleaned 


from a graphical analysis of the equation. 
Consider the nonlinear ordinary differential equation 


e = — = g(x? — 1). (1.6.4) 
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Figure 1.6.2: The phase line diagram for the ordinary differential equation, Equation 1.6.4. 


The time derivative x’ vanishes at x = —1,0,1. Consequently, if z(0) = 0, x(t) will remain 
zero forever. Similarly, if x(0) = 1 or z(0) = —1, then x(t) will equal 1 or —1 for all 
time. For this reason, values of x for which the derivative x’ is zero are called rest points, 
equilibrium points, or critical points of the differential equation. 

The behavior of solutions near rest points is often of considerable interest. For example, 
what happens to the solution when z is near one of the rest points x = —1,0,1? 

Consider the point x = 0. For x slightly greater than zero, z' < 0. For x slightly less 
than 0, 2’ > 0. Therefore, for any initial value of x near x = 0, x will tend to zero. In 
this case, the point x = 0 is an asymptotically stable critical point because whenever «x is 
perturbed away from the critical point, it tends to return there again. 

Turning to the point x = 1, for x slightly greater than 1, x’ > 0; for æ slightly less 
than 1, x’ < 0. Because any x near x = 1, but not equal to 1, will move away from x = 1, 
the point x = 1 is called an unstable critical point. A similar analysis applies at the point 
x — —]. This procedure of determining the behavior of an ordinary differential equation 
near its critical points is called a graphical stability analysis. 


e Phase line 


A graphical representation of the results of our graphical stability analysis is the phase 
line. On a phase line, the equilibrium points are denoted by circles. See Figure 1.6.2. Also 
on the phase line we identify the sign of x’ for all values of x. From the sign of x’, we then 
indicate whether z is increasing or decreasing by an appropriate arrow. If the arrow points 
toward the right, x is increasing; toward the left x decreases. Then, by knowing the sign 
of the derivative for all values of x, together with the starting value of x, we can determine 
what happens as t — oo. Any solution that is approached asymptotically as t — oo is called 
a steady-state output. In our present example, x = 0 is a steady-state output. 


Problems 
In previous sections, you used various techniques to solve first-order ordinary differential 
equations. Now check your work by using MATLAB to draw the direction field and plot 
your analytic solution for the following problems taken from previous sections: 
1. Section 1.2, Problem 5 2. Section 1.3, Problem 1 


3. Section 1.4, Problem 5 4. Section 1.5, Problem 3 


For the following autonomous ordinary differential equations, draw the phase line. Then 
classify each equilibrium solution as either stable or unstable. 


5. z/ = ox(1— x)(x — 3) 6. x! = (a? — 1)(a? — 4) 
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T. Y! 2 —4Ar — r’ 8. a! = 4z — r’ 
1.7 NUMERICAL METHODS 


By now you have seen most of the exact methods for finding solutions to first-order 
ordinary differential equations. The methods have also given you a view of the general 
behavior and properties of solutions to differential equations. However, it must be admitted 
that in many instances exact solutions cannot be found and we must resort to numerical 
solutions. 

In this section we present the two most commonly used methods for solving differen- 
tial equations: Euler and Runge-Kutta methods. There are many more methods and the 
interested student is referred to one of countless numerical methods books. A straightfor- 
ward extension of these techniques can be applied to systems of first-order and higher-order 
differential equations. 


e Euler and modified Euler methods 
Consider the following first-order differential equation and initial condition: 


W 


dz f(x,y), y(o) = Yo. (1.7.1) 


Euler's method is based on a Taylor series expansion of the solution about zo or 
y(ao +h) = y(zo) + hy'(zo) + ty" (E), — zo «&£ «zo h, (1.7.2) 


where h is the step size. Euler's method consists of taking a sufficiently small h so that 
only the first two terms of this Taylor expansion are significant. 
Let us now replace y'(xo) by f(xo, yo). Using subscript notation, we have that 


igi = yi thf (vi, yi) + O(h?). (1.7.3) 


Equation 1.7.3 states that if we know the values of y; and f (xj, yi) at the position z;, then 
the solution at z;,1 can be obtained with an error!? O(h?). 

'The trouble with Euler's method is its lack of accuracy, often requiring an extremely 
small time step. How might we improve this method with little additional effort? 

One possible method would retain the first three terms of the Taylor expansion rather 
than the first two. This scheme, known as the modified Euler method, is 


Vig = Yi + hy’ (ai) + 59 y? + O(h’). (1.7.4) 


This is clearly more accurate than Equation 1.7.3. 
An obvious question is how do we evaluate yj’, because we do not have any information 
on its value. Using the forward derivative approximation, we find that 


/ / 
n Vii Wi 


" 1.7. 
V; h (1.7.5) 


12 The symbol O is a mathematical notation indicating relative magnitude of terms, namely that f(e) = 
O(e") provided lime.,o|f(c)/e"| < oo. For example, as € — 0, sin(e) = O(c), sin(c?) = O(e?), and 
cos(e) = O(1). 
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Substituting Equation 1.7.5 into Equation 1.7.4 and simplifying 


h 
Yi+1ı = Yi + 5 (yi + uiui) + O(h?). (1.7.6) 


Using the differential equation, 


Vii = Yi + : [F (xa, ys) + f (zii, Yi+1)] + OCA’). (1.7.7) 


Although f(z;,y;) at (xi, yi) are easily calculated, how do we compute f(xj41, yi41) at 
(£i+1,Yi+1)? For this we compute a first guess via the Euler method, Equation 1.7.3; 
Equation 1.7.7 then provides a refinement on the value of yi41. 

In summary then, the simple Euler scheme is 


Yiyi =Yitkit+O(h?), kı = hf(vi yi), (1.7.8) 
while the modified Euler method is 


igi = Yi + (Ki + ka) + O(N), ky = hf (zi yi), ka = hf (xi +h, yi + ki). (1.7.9) 


e Example 1.7.1 


Let us illustrate Euler's method by numerically solving 
4-3 d x(0) — 1. (1.7.10) 


A quick check shows that Equation 1.7.10 has the exact solution exact(t) = 2ef — t — 1. 
Using the MATLAB script: 


clear 

for i = 1:3 

^4 set up time step increment and number of time steps 
h = 1/10^i; n = 10/h; 

% set up initial conditions 
t-zeros(nti,1); t(1) = 0; 


x_euler=zeros(n+1,1); x euler(1) = 1; 
xmodified-zeros(n*i,1); x modified(1) = 1; 
x exact-zeros(n*i,1); x exact(1) = 1; 


^4 set up difference arrays for plotting purposes 
diffi = zeros(n,1); diff2 = zeros(n,1); tplot = zeros(n,1); 
^4 define right side of differential equation, Equation 1.7.10 
f = inline? xxttt? ," tt? ,? xx?) ; 
for k = 1:n 
t(k+1) = t(k) +h; 
^4 compute exact solution 
x_-exact(k+1) = 2*exp(t(k+1)) - t(k+1) - 1; 
^4 compute solution via Euler’s method 
ki = h * £(t(k),x_euler(k)); 
x_euler(k+1) = x_euler(k) + k1; 
tplot(k) = t(k+1); 
diffi(k) = x_euler(kt+1) - x exact(k*1); 
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Figure 1.7.1: The relative error [x(t) — Zexact(t)|/®exact(t) of the numerical solution of Equation 1.7.10 
using Euler's method (the solid line) and modified Euler's method (the dotted line) with different time steps 
h. 


diffil(k) = abs(diffl(k) / x exact(k*1)); 
^4 compute solution via modified Euler method 
ki = h * f(t(k),x modified(k)); 
k2 = h * f(t(k*1),x modified(k)-*k1); 
x_modified(k+1) = x modified(k) + O.5*(k1-k2); 
diff2(k) = x_modified(k+1) - x exact(k-*1); 
diff2(k) = abs(diff2(k) / x exact(k*1)); 
end 
% plot relative errors 
semilogy(tplot,diff1,’-’,tplot,diff2,’:’) 
hold on 
xlabel (’TIME’ ,’Fontsize’ ,20) 
ylabel(’ |RELATIVE ERROR|’,’Fontsize’ ,20) 
legend(’Euler method’, ’modified Euler method’) 
legend boxoff; 
numi = 0.2*n; num2 = 0.8*n; 
text(3,diffi(numi),[?h = ’ ,num2str(h)],’Fontsize’,15,... 
>HorizontalAlignment’,’right’,... 
?VerticalAlignment’ ,’ bottom’) 
text (9,diff2(num2) ,[’h = ’,num2str(h)],’Fontsize’,15,... 
>HorizontalAlignment’,’right’,... 
?VerticalAlignment’ ,’ bottom’) 
end 


Both the Euler and modified Euler methods have been used to numerically integrate Equa- 
tion 1.7.10 and the absolute value of the relative error is plotted in Figure 1.7.1 as a function 
of time for various time steps. In general, the error grows with time. The decrease of error 
with smaller time steps, as predicted in our analysis, is quite apparent. Furthermore, the 
superiority of the modified Euler method over the original Euler method is clearly seen. 
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e Runge-Kutta method 


As we have just shown, the accuracy of numerical solutions of ordinary differential 
equations can be improved by adding more terms to the Taylor expansion. The Runge- 
Kutta method!’ builds upon this idea, just as the modified Euler method did. 

Let us assume that the numerical solution can be approximated by 


Yi+ı = yi + akı + bk», (1.7.11) 


where 


Here a, b, A1, and B, are four unknowns. Equation 1.7.11 was suggested by the modified 
Euler method that we just presented. In that case, the truncated Taylor series had an error 
of O(h?). We anticipate such an error in the present case. 

Because the Taylor series expansion of f(x +h,y + k) about (x,y) is 


f(a +h, y +k) = f(x,y) + (hfe +kfy) + 1 (h? frs + 2hk fry +k? fyy) 


+ i (h? Pes + 3h? frey + 3hE? fou, + k? fyyy) Te, (1.7.13) 
kə can be rewritten 
ko = hf|v; + Arh, yi + Bhf(vi,vi)] (1.7.14) 
= h |f (xi yi) + (Ath fe + Bihf fy)| (1.7.15) 
=hf+ Ah? fs + Bil’ f fy, (1.7.16) 


where we have retained only terms up to O(h?) and neglected all higher-order terms. Finally, 
substituting Equation 1.7.16 into Equation 1.7.11 gives 


This equation corresponds to the second-order Taylor expansion: 
Yin = Yi + hy, i^y. (1.7.18) 


Therefore, if we wish to solve the differential equation y' = f(x, y), then 


y = fe + fyy = fe + Í fy- (1.7.19) 
Substituting Equation 1.7.19 into Equation 1.7.18, we have that 
Vii = Yi + hf + 4h?(fe + ffy). (1.7.20) 


A direct comparison of Equation 1.7.17 and Equation 1.7.20 yields 


a+b=1,  Ajb-—i, and Bıb=4. (1.7.21) 


13 Runge, C., 1895: Ueber die numerische Auflösung von Differentialgleichungen. Math. Ann., 46, 167- 
178; Kutta, W., 1901: Beitrag zur näherungsweisen Integration totaler Differentialgleichungen. Zeit. Math. 
Phys., 46, 435-453. For a historical review, see Butcher, J. C., 1996: A history of Runge-Kutta methods. 
Appl. Numer. Math., 20, 247-260 and Butcher, J. C., and G. Wanner, 1996: Runge-Kutta methods: Some 
historical notes. Appl. Numer. Math., 22, 113-151. 
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Although Carl David Tolmé Runge (1856-1927) began his studies in Munich, his friendship with 
Max Planck led him to Berlin and pure mathematics with Kronecker and Weierstrass. It was his 
professorship at Hanover beginning in 1886 and subsequent work in spectroscopy that led him to his 
celebrated paper on the numerical integration of ordinary differential equations. Runge's final years 
were spent in Góttingen as a professor in applied mathematics. (Portrait taken with permission from 
Reid, C., 1976: Courant in Góttingen and New York: The Story of an Improbable Mathematician. 
Springer-Verlag, 314 pp. ©1976, by Springer-Verlag New York Inc.) 


'These three equations have four unknowns. If we choose a — i, we immediately calculate 
b= 4 and A; = B, = 1. Hence the second-order Runge-Kutta scheme is 


Vii = yi + 5 (hi + Ka), (1.7.22) 


where ky = hf(ai,y;) and kg = hf(a; + h,y; + kı). Thus, the second-order Runge-Kutta 
scheme is identical to the modified Euler method. 

Although the derivation of the second-order Runge-Kutta scheme yields the modified 
Euler scheme, it does provide a framework for computing higher-order and more accurate 
schemes. A particularly popular one is the fourth-order Runge-Kutta scheme 


Yer = Yi + $ (kı + 2ka + 2ks + ka), (1.7.23) 
where 
ky = hf (xi, ya), (1.7.24) 
kə = hf (ai + 5h, yi + 31), (1.7.25) 
ks = hf (zi + 3h; yi $12), (1.7.26) 
and 


ka = hf (zi + h, yi + ka). (1.7.27) 
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Martin Wilhelm Kutta (1867-1944) was an academic (primarily in mathematics) who held posi- 
tions at Munich, Jena, Aachen and Stuttgart between 1894 and 1936. It was during his doctorial 
thesis (Beiträge zur nüherungsweisen Integration totaler Differentialgleichungen) at the University 
of Munich that he developed the Runge-Kutta method for the numerical integration of ordinary 
differential equations based upon an 1895 publication by Runge. 


e Example 1.7.2 


Let us illustrate the fourth-order Runge-Kutta by redoing the previous example using 


the MATLAB script: 


clear 


^ 


test out different time steps 


for i= 1:4 


^ 


^ 


^ 


set up time step increment and number of time steps 


if i==1 h = 0.50; end; if i==2 h = 0.10; end; 
if i--3 h = 0.05; end; if i--4 h = 0.01; end; 
n = 10/h; 


set up initial conditions 
t=zeros(nti,1); t(1) = 0; 
xrk-zeros(nti,1); xrk(1) = 1; 
x exact-zeros(n*i,1); x exact(1) = 1; 
set up difference arrays for plotting purposes 
diff - zeros(n,1); tplot - zeros(n,1); 
define right side of differential equation 
f = inline xxctt? ,? tt? ,? xx?) ; 
for k = 1:n 
x_local = x rk(k); t local = t(k); 


ki = h * f(t local,x local); 

k2 = h * f(t.local + h/2,x local + k1/2); 
k3 = h * f(t local + h/2,x local + k2/2); 
k4 = h * f(t local + h,x local + k3); 


t(k+1) = t local + h; 
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Figure 1.7.2: Same as Figure 1.7.1 except that we have used the fourth-order Runge-Kutta method. 


x rk(k*1) 


x local + (k1+2*k2+2*k3+k4) / 6; 


x_exact(k+1) = 2*exp(t(k+1)) - t(k+1) - 1; 


tplot (k) 
diff (k) 
diff (k) 


end 


% plot relative errors 
semilogy(tplot,diff,’-’) 
hold on 


tO); 
x_rk(k+1) - x exact(k*1); 
abs(diff(k) / x. exact(k*1)); 


xlabel(C TIME! ,?Fontsize'!,20) 
ylabel(C |RELATIVE ERROR|?,?Fontsize?,20) 


numi = 2*i; num2 = 0.2*n; 
text (numi,diff(num2),[’h = ’,num2str(h)],’Fontsize’,15,... 


>HorizontalAlignment’,’right’,... 
?VerticalAlignment’ ,’ bottom’) 


end 


The error growth with time is shown in Figure 1.7.2. Although this script could be used 
for any first-order ordinary differential equation, the people at MATLAB have an alternative 
called ode45, which combines a fourth-order and a fifth-order method that are similar to 
our fourth-order Runge-Kutta method. Their scheme is more efficient because it varies the 
step size, choosing a new time step at each step in an attempt to achieve a given desired 


accuracy. 


e Adams-Bashforth method 


All of the methods presented so far (Euler, modified Euler, Runge-Kutta) are single 
point methods; the solution at 1+ 1 depends solely on a single point i. A popular alternative 
to these schemes are multistep methods that compute y;41 by reusing previously obtained 
values of y, where n < i. 

We begin our derivation of a multistep method by rewriting Equation 1.7.1 as 


dy = f (x, y) dz. (1.7.28) 
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Integrating both sides of Equation 1.7.28, we obtain 
Tip. Til 
vem) —ylas) = | m] fena (1.7.29) 


The Adams-Bashforth method!^ replaces the integrand in Equation 1.7.29 with an approx- 
imation derived from Newton's backward difference formula: 


f(z,y) = fi £V fi + ZEE - DV f; + EEF 1)(6 - 2)? fi, (1.7.30) 


where € = (x — z;)/h or x = zi + h£, 


V fi = f (xi yi) — f(zi-i yii). (1.7.31) 
V? f; = f(zi, yi) — 2f (zii yii) + f(zi-2, Yi-2), (1.7.32) 

and 
V3 f; = f(zi yi) — 3f (zii yi-1) + 3f (zi-2, vi-2) — f (via, yi-3)- (1.7.33) 


Substituting Equation 1.7.30 into Equation 1.7.29 and carrying out the integration, we find 
that 


y(zi+1) = y(vi) + x [55 f (zi, yi) — 59f (zii, yii) + 37 fF (wi-2, yz) — 9f (xi-3 yi-3)]- 
(1.7.34) 
Thus, the Adams-Bashforth method is an explicit finite difference formula that has a global 
error of O(h*). Additional computational savings can be realized if the old values of the 
slope are stored and used later. A disadvantage is that some alternative scheme (usually 
Runge-Kutta) must provide the first three starting values. 


e Example 1.7.3 


'The flight of projectiles provides a classic application of first-order differential equa- 
tions. If the projectile has a mass m and its motion is opposed by the drag mgkv?, where 
g is the acceleration due to gravity and k is the quadratic drag coefficients, Newton's law 
of motion gives 

dv 
dt 


where 0 is the slope of the trajectory to the horizon. From kinematics, 


— —gsin(0) — gkv?, (1.7.35) 


dz _ dy. — dð ^ gcos(0) 
—- = v cos(0), di^ Un), m lc 


(1.7.36) 


An interesting aspect of this problem is the presence of a system of ordinary differential 
equations. 


14 Bashforth, F., and J. C. Adams, 1883: An Attempt to Test the Theories of Capillary Action by 
Comparing the Theoretical and Measured Forms of Drops of Fluid. With an Explanation of the Method 
of Integration Employed in Constructing the Tables Which Give the Theoretical Forms of Such Drops. 
Cambridge University Press, 139 pp. 
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Although we can obtain an exact solution to this problem,!? let us illustrate the Adams- 
Bashforth method to compute the solution to Equation 1.7.35 and Equation 1.7.36. We 
begin by computing the first three time steps using the Runge-Kutta method. Note that 
we first compute the kı for all of the dependent variables before we start computing the 
values of ky. Similar considerations hold for kg and k4. 


clear 

a=0; b = 7.85; N = 100; g = 9.81; c 
h = (b-a)/N; t = (a:h:bth); 

^ set initial conditions 

v(1) = 44.69; theta(1) = pi/3; x(1) = 0; y(1) = 0; 


0.000548; 


for i - 1:3 
angle = theta(i); vv = v(i); 
ki vel = -g*sin(angle) - g*c*vv*vv; 


ki angle - -g*cos(angle) / vv; 

ki x = vv * cos(angle); 

ki y = vv * sin(angle); 

angle = theta(i)+h*kl_angle/2; vv = v(i)*h*kl.vel/2; 

k2 vel = -g*sin(angle) - g*c*vv*vv; 

k2 angle = -g*cos(angle) / vv; 

k2 x = vv * cos(angle); 

k2 y = vv * sin(angle); 

angle = theta(i)+h*k2_angle/2; vv = v(i)*h*k2 vel/2; 

k3 vel = -g*sin(angle) - g*c*vv*vv; 

k3 angle = -g*cos(angle) / vv; 

k3.x = vv * cos(angle); 

k3 y = vv * sin(angle); 

angle = theta(i)th*k3 angle; vv = v(i)th*k3 vel; 

k4 vel = -g*sin(angle) - g*c*vv*vv; 

k4 angle = -g*cos(angle) / vv; 

k4 x = vv * cos(angle); 

kA y = vv * sin(angle); 

v(i*1) = v(i) + h*(k1 vel42*k2 vel*2*k3. vel-*k4. vel)/6; 

x(i*1) = x(i) + h*(k1 x*2*k2 x*2*k3 x*k4 x)/6; 

y(i*1) = y(i) + h*(k1 y42*k2 y*2*k3 y*k4 y)/6; 

theta(i*1) = theta(i) + h*(k1 angle42*k2 angle ... 
*2*k3 angletk4 angle)/6; 

end 


Having computed the first three values of each of the dependent variables, we turn to 
the Adams-Bashforth method to compute the remaining portion of the numerical solution: 
for i = 4:N 

angle = theta(i); vv = v(i); 

ki vel = -g*sin(angle) - g*c*vv*vv; 
ki angle - -g*cos(angle) / vv; 

ki x = vv * cos(angle); 

ki y = vv * sin(angle); 


15 Tan, A., C. H. Frick, and O. Castillo, 1987: The fly ball trajectory: An older approach revisited. Am. 
J. Phys., 55, 37-40; Chudinov, P. S., 2001: The motion of a point mass in a medium with a square law of 
drag. J. Appl. Math. Mech., 65, 421—426. 


First-Order Ordinary Differential Equations 


80 T T T T 


— k = 0.000548 
ao -—-—kz0 
^ 
os | 
* 
^ 
* 
` | 
s 
^ 
` 
` | 
i 
iJ 
` 
M 4 
` 
` 
` 
` 4 
v 
M 
` 
x | 
V 
V 
M 
` 
` 
` 
L L 1 L 
0 20 40 60 80 100 120 140 160 180 
X 
Figure 1.7.3: The trajectory of a projectile with and without air resistance when i 


a muzzle velocity of 44.69 m/s and an elevation of 0 — 60?. All units are in the MKS 
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is initially fired with 
system. 


angle 
k2 vel 


= theta(i-1); vv = v(i-1); 


= -g*sin(angle) - g*c*vv*vv; 


k2 angle = -g*cos(angle) / vv; 


k2x = 
k2 y = 
angle 

k3. vel 


vv * cos(angle); 


vv * sin(angle); 


= theta(i-2); vv = v(i-2); 


= -g*sin(angle) - g*c*vv*vv; 


k3 angle = -g*cos(angle) / vv; 


k3.x - 
k3.y = 
angle 

k4. vel 


vv * cos(angle); 


vv * sin(angle); 


= theta(i-3); vv = v(i-3); 


= -g*sin(angle) - g*c*vv*vv; 


k4 angle = -g*cos(angle) / vv; 


k4 x = 
k4 y = 


vv * cos(angle); 


vv * sin(angle); 


4 Use Equation 1.7.35 and Equation 1.7.36 for v, x, y and 0 


v(it1) 
x(i*1) 
y (it+1) 


= y(i) + h*(bb*k1 vel-59*k2 vel*37*k3 vel-9*k4 vel)/24; 
= x(i) + h*(55*k1_x-59*k2_x+37*k3_x-9*k4_x)/24; 
= y(i) + h*(55*k1_y-59*k2_y+37*k3_y-9*k4_y)/24; 


theta(it1) = theta(i) + h*(55*k1l angle-59*k2 angle ... 


end 


*37*k3 angle-9*k4 angle)/24; 


Figure 1.7.3 illustrates this numerical solution when k — 0 and k — 0.000548 s?/m? 
and the shell is fired with the initial velocity v(0) = 44.69 m/s and elevation 6(0) = 7/3 
with z(0) — y(0) — 0. 
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Figure 1.7.4: The numerical solution of the equation describing an electrical circuit with a nonlinear 
resistor. Here 8 = 0.2 and At = 0.01. 

Problems 
Using Euler’s, Runge-Kutta, or the Adams-Bashforth method for various values of h = 
107", find the numerical solution for the following initial-value problems. Check your 
answer by finding the exact solution. 
l.a’=a-t, x(0)=2 2. z/—tz, x(0)=1 
3.2 = x°/(t+1), a(0)e1 4. x! =xr+e™, z(1)20 


5. Consider the integro-differential equation 
t 
at f cere Bum =i, mazo 
0 


where the signum function is defined by 


1, t0, 
sgn(t) — 0, t=0, 
—1, t « 0. 


This equation describes the (nondimensional) current,!Ó z(t), within an electrical circuit 
that contains a capacitor, inductor, and nonlinear resistor. Assuming that the circuit is 
initially dead, x(0) = 0, write a MATLAB script that uses Euler's method to compute z(t). 
Use a simple Riemann sum to approximate the integral. See Figure 1.7.4. Examine the 
solution for various values of B and 8 as well as time step At. 


16 Monahan, T. F., 1960: Calculation of the current in non-linear surge-current-generation circuits. Proc. 
IEE, Part C, 107, 288-291. 
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Euler explicit scheme 


Euler implicit scheme 


-0.5 


0 0.5 1 1.5 2 2.5 3 


Figure 1.7.5: The numerical solution of a stiff differential equation (stated in Problem 6) using Euler's 
explicit and implicit schemes with At — 1/25.5. The solid line is the exact solution while the dashed line 
gives the numerical solution. 


6. Consider the initial-value problem: 


WW --soly()-cos()], — w0)- 0. 


Step 1: Solve this problem exactly and show that 


y(t) [sin(t) + 50 cos(t)] — : 


| 50 
~ 2501 


Step 2: Let us introduce a time step At so that tn = nAt with n = 0,1,2,.... Then we can 
find a numerical solution to our initial-value problem using the explicit Euler method: 


y(tn + At) — y(tn) 
At 


= —50 [y(t4) — cos(tn)] . 


with y(to) = 0, or 
Yn+1 = Un — 50At [yn TE cos(t,,)] ; Yo = 0, 


where yn = y(t). Write code and compare this numerical solution with the exact solution 
for various values of At. 


Step 3: An alternative method to the explicit scheme is the (implicit) backward Euler 


scheme: 
y(tn + At) — y(tn) 
At 


= —50[y(tn + At) — cos(tn41)], 


or 
(1 + 50At) Un--1 = Un + 50At cos(tn+1), Yo 


II 
> 
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Redo Step 2 and compare this numerical scheme with the exact solution as a function of 
time step At. 

This problem involves a stiff differential equation, a differential equation for which 
certain numerical methods used to solve the equation (here the explicit Euler method) are 
unstable unless the time step is taken to be extremely small. Stiff differential equations are 
characterized by solutions that decay rapidly or oscillate rapidly. 


Further Readings 


Boyce, W. E., and R. C. DiPrima, 2004: Elementary Differential Equations and Boundary 
Value Problems. Wiley, 800 pp. Classic textbook. 


Ince, E. L., 1956: Ordinary Differential Equations. Dover, 558 pp. The source book on 
ordinary differential equations. 


Zill, D. G., and M. R. Cullen, 2008: Differential Equations with Boundary- Value Problems. 
Brooks Cole, 640 pp. Nice undergraduate textbook. 
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Chapter 2 
Higher-Order Ordinary 
Differential Equations 


Although first-order ordinary differential equations exhibit most of the properties of 
differential equations, higher-order ordinary differential equations are more ubiquitous in 
the sciences and engineering. This chapter is devoted to the most commonly employed 
techniques for their solution. 

A linear nth-order ordinary differential equation is a differential equation of the form 


dn dn-i d 
a, (z) —. + an—1(x) e da) Z + ao(z)y = f (a). (2.0.1) 
dx dx dx 


If f(a) = 0, then Equation 2.0.1 is said to be homogeneous; otherwise, it is nonhomogeneous. 
A linear differential equation is normal on an interval I if its coefficients and f(x) are 
continuous, and the value of a,,(x) is never zero on T. 

Solutions to Equation 2.0.1 generally must satisfy not only the differential equations 
but also certain specified conditions at one or more points. Initial-value problems are 
problems where all of the conditions are specified at a single point x = a and have the 
form: yla) = bo, y/(a) = bi, y" (a) = be, ...., YTD (a) = b, 4, where bo, bi, be, ..., bn—1 
are arbitrary constants. A quick check shows that if Equation 2.0.1 is homogeneous and 
normal on an interval J and all of the initial conditions equal zero at the point x = a that 
lies in J, then y(x) = 0 on I. This follows because y = 0 is a solution of Equation 2.0.1 and 
satisfies the initial conditions. 


4T 
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At this point, a natural question would be whether the solution exists for this initial- 
value problem and, if so, whether it is unique. From a detailed study of this question,! we 
have the following useful theorem. 


Theorem: Existence and Uniqueness 


Suppose that the differential equation, Equation 2.0.1, is normal on the open interval 
I containing the point x =a. Then, given n numbers bo, bı, ..., b, 1, the nth-order linear 
equation, Equation 2.0.1, has a unique solution on the entire interval I that satisfies the n 
initial conditions y(a) = bo, y (a) = b1, ... y^ P (a) = b, . 


e Example 2.0.1 


The solution y(x) = ser — iem to the ordinary differential equation y" --2y" —y' —2y = 
0 satisfies the initial conditions y(0) = 1, y'(0) = 2, and y"(0) = 0 at x = 0. Our theorem 


guarantees us that this is the only solution with these initial values. 


Another class of problems, commonly called (two-point) boundary-value problems, oc- 
curs when conditions are specified at two different points x = a and x = b with b > a. 
An important example, in the case of second-order ordinary differential equations, is the 
Sturm-Liouville problem where the boundary conditions are o y(a) + 81y'(a) = 0 at x = a 
and agy(b) + Boy’(b) = 0 at x = b. The Sturm-Liouville problem is treated in Chapter 11. 

Having introduced some of the terms associated with higher-order ordinary linear dif- 
ferential equations, how do we solve them? One way is to recognize that these equations 
are really a set of linear, first-order ordinary differential equations. For example, the linear 
second-order linear differential equation 


y" — 3y' + 2y = 3a (2.0.2) 
can be rewritten as the following system of first-order ordinary differential equations: 
y —y=v, and v' — 2w = 3x (2.0.3) 
because 
y! — y =v = 2v 4 3x = 2y' — 2y + 32, (2.0.4) 


which is the same as Equation 2.0.2. This suggests that this equation can be solved by 
applying the techniques from the previous chapter. Proceeding along this line, we first find 
that 


v(x) = Cie” — 3a — 3. (2.0.5) 


Therefore, 
y -y= Cie? = ic — 2. (2.0.6) 


Again, applying the techniques from the previous chapter, we have that 
y= Cie?" + Coe” + ic + 2. (2.0.7) 


Note that the solution to this second-order ordinary differential equation contains two ar- 
bitrary constants. 


1 The proof of the existence and uniqueness of solutions to Equation 2.0.1 is beyond the scope of this 
book. See Ince, E. L., 1956: Ordinary Differential Equations. Dover Publications, Inc., Section 3.32. 
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e Example 2.0.2 


In the case of linear, second-order ordinary differential equations, a similar technique, 
called reduction in order, provides a method for solving differential equations if we know 
one of its solutions. 

Consider the second-order ordinary differential equation 


ay” — 5ay’ + 9y = 0. (2.0.8) 


A quick check shows that yı(x) = x? In(z) is a solution of Equation 2.0.8. Let us now 
assume that the general solution can be written y(x) = u(z)z? ln(x). Then 


y' = u'(z)a? In(z) + u(x) [322 ln(x) + x°], (2.0.9) 
and 
y" = u" (z)z? n(x) + 2u' (x) [32 ln(x) + x°] + u(x) [6z1n(z) + 52]. (2.0.10) 
Substitution of y(x), y'(x), and y"(x) into Equation 2.0.8 yields 
z? In(z)u" + [z^ ln(x) + 224] v = 0. (2.0.11) 
Setting u’ = w, separation of variables leads to 
w! 1 2 


w c x ln(x) 0d) 


Note how our replacement of u'(z) with w(x) has reduced the second-order ordinary differ- 
ential equation to a first-order one. Solving Equation 2.0.12, we find that 


Cy 
— w(z)--——— 2.0.13 
wir) e wr) m E (2013) 
and 
(nes obo (2.0.14) 
UL) = n(x) 2. .U. 
Because y(x) = u(z)a? In(z), the complete solution is 
y(x) = Cia? + Coa? ln(a)). (2.0.15) 


Substitution of Equation 2.0.15 into Equation 2.0.8 confirms that we have the correct solu- 
tion. 

We can verify our answer by using the symbolic toolbox in MATLAB. Typing the com- 
mand: 
dsolve(’?x*x*D2y-5*x*Dy+9*y=0’ ,’x’) 
yields: 
ans = 
C1*x^34C2*x^3*1log(x) 
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In summary, we can reduce (in principle) any higher-order, linear ordinary differential 
equations into a system of first-order ordinary differential equations. This system of differ- 
ential equations can then be solved using techniques from the previous chapter. In Chapter 
3 we will pursue this idea further. Right now, however, we will introduce methods that 
allow us to find the solution in a more direct manner. 


e Example 2.0.3 
An autonomous differential equation is one where the independent variable does not 
appear explicitly. In certain cases we can reduce the order of the differential equation and 
then solve it. 
Consider the autonomous ordinary differential equation 
y" = 2y*. (2.0.16) 
'The trick here is to note that 


v? =y C4. (2.0.18) 


Solving for v, 
d 
» =y= fry. (2.0.19) 


Integrating once more, we have the final result that 


dy 
r+C - {/ 2.0.20 
2 Gag ( ) 
Problems 


For the following differential equations, use reduction of order to find a second solution. 
Can you obtain the general solution using dsolve in MATLAB? 


1. zy" +2y'=0, yi(z)=1 2. cy —2y 20, yi(x) =e* 

3. z?y" + 4ry'—4y=0, ylr)=x 4. zy" — (zx -1y -y—0, y(r) =e” 

5. (2x — z?)y" + 2(x — 1)y' — 2y = 0, 6. y" + tan(z)y' — 6 cot?(x)y = 0, 
uwu(r)-z-1 yi (x) = sin? (x 

7. Ax? y" + day’ + (4x? — 1)y =0, 8. y" + ay’ + b(1-- ax ba?)y = 0, 
yi(x) = cos(a)/ V/v u(z)-e P 


Solve the following autonomous ordinary differential equations: 


9. yy" =y” 10. y” = 2yy', y(0-—y(0-1 


Higher-Order Ordinary Differential Equations 51 


11. yy" 2 y +y”? 12. 2yy" 21-4 y? 
13. y” 2e?, y(0) =0,y'(0) =1 14. y" 23yy, y(0—(0-—1,39"(0-3 
15. Solve the nonlinear second-order ordinary differential equation 


d'y 1dy 1/dy " 
dr? xdr 2 


by (1) reducing it to the Bernoulli equation 


(2) solving for v(x), and finally (3) integrating u' = v to find u(x). 
16. Consider the differential equation 
ag(x)y" + ai(z)y +ao(z)y=0, a(x) #0. 


Show that this ordinary differential equation can be rewritten 


diii JOS : | 


using the substitution 


SEE 


2.1 HOMOGENEOUS LINEAR EQUATIONS WITH CONSTANT COEFFICIENTS 


In our drive for more efficient methods to solve higher-order, linear, ordinary differential 
equations, let us examine the simplest possible case of a homogeneous differential equation 
with constant coefficients: 


n n-—1 
y d" y n dy _ 
Ora as ONL a aci bir T day "mp: + aoy = 0. (2.1.1) 
Although we could explore Equation 2.1.1 in its most general form, we will begin by studying 
the second-order version, namely 


ay" + by’ + cy = 0, (2.1.2) 


since it is the next step up the ladder in complexity from first-order ordinary differential 
equations. 

Motivated by the fact that the solution to the first-order ordinary differential equation 
y' + ay = 0 is y(x) = Cie ?*, we make the educated guess that the solution to Equation 
2.1.2 is y(x) = Ae". Direct substitution into Equation 2.1.2 yields 


(am? + bm + c) Ae™ = Q. (2.1.3) 
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The constant A cannot equal 0 because that would give y(x) = 0 and we would have a 
trivial solution. Furthermore, since e™” Æ 0 for arbitrary x, Equation 2.1.3 simplifies to 


am? -- bm 4- c — 0. (2.1.4) 


Equation 2.1.4 is called the auxiliary or characteristic equation. At this point we must 
consider three separate cases. 


e Distinct real roots 


In this case the roots to Equation 2.1.4 are real and unequal. Let us denote these roots 
by m = mı, and m = m». Thus, we have the two solutions: 


yıls) = Cie", and ya(x) = Coe™*. (2.1.5) 
We will now show that the most general solution to Equation 2.1.2 is 
y(x) = Cye™ ® + Coe™??. (2.1.6) 
This result follows from the principle of (linear) superposition. 


Theorem: Let yi1,yo,..., yx be solutions of the homogeneous equation, Equation 2.1.1, on 
an interval I. Then the linear combination 


y(z) = Ciy (x) + Coya(x) +--+ + Cxyx(x), (2.1.7) 
where Ci, i = 1,2,...,k, are arbitrary constants, is also a solution on the interval I. 
Proof: We will prove this theorem for second-order ordinary differential equations; it is 
easily extended to higher orders. By the superposition principle, y(x) = Ciy1(x) + Coys(x). 
Upon substitution into Equation 2.1.2, we have that 


à (Ciy] + Coys) + b (Ci, + Coys) + c(Ciyi + Coy2) = 0. (2.1.8) 


Recombining the terms, we obtain 


C; (ayy + byi + cy1) + C» (ay + bys + cy») = 0, (2.1.9) 
or 
0C, + 0C; = 0. (2.1.10) 


e Example 2.1.1 


A quick check shows that y;(x) = e” and ys(x) = e^* are two solutions of y" — y = 0. 
Our theorem tells us that any linear combination of these solutions, such as y(x) = 5e* — 
3e" *?, is also a solution. 

How about the converse? Is every solution to y" — y = 0 a linear combination of yı (x) 
and yo(x)? We will address this question shortly. 
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e Example 2.1.2 
Let us find the general solution to 
y" + 2y' — 15y = 0. (2.1.11) 
Assuming a solution of the form y(x) = Ae", we have that 
(m? + 2m — 15)Ae™ = 0. (2.1.12) 
Because A Æ 0 and e”” generally does not equal zero, we obtain the auxiliary or charac- 


teristic equation 
m? + 2m — 15 = (m + 5)(m — 3) = 0. (2.1.13) 


Therefore, the general solution is 


y(x) = C1e?* + Coe”. (2.1.14) 


e Repeated real roots 
When m = m; = ms», we have only the single exponential solution yı (x) = Cye™*. 


To find the second solution we apply the reduction of order technique shown in Example 
2.0.2. Performing the calculation, we find 


me" eg /a 
y» (a) = Coe™! ] dx. (2.1.15) 


Since mı = —b/(2a), the integral simplifies to f dx and 


y(x) = Cie"? + Core™”. (2.1.16) 


e Example 2.1.3 
Let us find the general solution to 
y" +4y' + 4y = 0. (2.1.17) 
Here the auxiliary or characteristic equation is 
m? -- Am - 4 5 (m 4-2)? =0. (2.1.18) 
'Therefore, the general solution is 


y(x) = (C1 + C5z)e "^". (2.1.19) 
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e Complez conjugate roots 


When b? — 4ac < 0, the roots become the complex pair m, = a + iĝ and mz = a — fii, 
where o and f are real and i? = —1. Therefore, the general solution is 


y(x) = Ciel tiO 4+ ceo Bie, (2.1.20) 


Although Equation 2.1.20 is quite correct, most engineers prefer to work with real 
functions rather than complex exponentials. To this end, we apply Euler’s formula to 
eliminate etf” and e^?" since 


e'P® = cos(Bx) + isin(fz), (2.1.21) 
and 
e 5?" = cos(Bx) — isin( 8x). (2.1.22) 
Therefore, 
y(x) = Cye®* [cos(fx) + isin(fx)] + Cpe” [cos(8x) — isin(8z)] (2.1.23) 
= Cze™ cos(Bx) + C4e^* sin(fix), (2.1.24) 


where C3 = C + C5, and C4 = iC — iC. 
e Example 2.1.4 
Let us find the general solution to 
y" + Ay + 5y — 0. (2.1.25) 


Here the auxiliary or characteristic equation is 


m? -- Am 4-5 — (m -2)? - 1 — 0, (2.1.26) 
or m = —2 + i. Therefore, the general solution is 
y(x) = e^?*[C; cos(x) + C» sin(z)]. (2.1.27) 


So far we have only dealt with second-order differential equations. When we turn 
to higher-order ordinary differential equations, similar considerations hold. In place of 
Equation 2.1.4, we now have the nth-degree polynomial equation 


anm” + anim”! +--+ E agm? 4c aqm + ag — 0 (2.1.28) 


for its auxiliary equation. 

When we treated second-order ordinary differential equations, we were able to classify 
the roots to the auxiliary equation as distinct real roots, repeated roots, and complex 
roots. In the case of higher-order differential equations, such classifications are again useful, 
although all three types may occur with the same equation. For example, the auxiliary 
equation 

m$ — m? + 2m* — 2m? +m? — m «0 (2.1.29) 
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has the distinct roots m = 0 and m = 1 with the twice repeated, complex roots m = +1. 
Although the possible combinations increase with higher-order differential equations, 
the solution technique remains the same. For each distinct real root m = mı, we have a 
corresponding homogeneous solution e"'!*?, For each complex pair m = a+ ffi, we have the 
corresponding pair of homogeneous solutions e?* cos(8x) and e°” sin(Bx). For a repeated 
root m = m of multiplicity k, regardless of whether it is real or complex, we have either 


eM ygmiz 429miz./.. ykemi? in the case of real m4 or 


e?* cos( Bx), e°” sin(Bz), xe?* cos(x), ze?" sin(fix), 


x? e?" cos(Bx), z?2e?" sin(Bz), ... , z"e?* cos(Bx), "e^" sin(Bx) 


in the case of complex roots a + £i. For example, the general solution for the roots to 
Equation 2.1.29 is 


y(x) = Cy + Coe” + Cs cos(x) + Cy sin(x) + Cz cos(x) + Cox sin(x). (2.1.30) 


e Example 2.1.5 
Let us find the general solution to 
y" +y' — 10y — 0. (2.1.31) 


Here the auxiliary or characteristic equation is 


m? +m — 10 = (m — 2) (m? + 2m + 5) = (m — 2)[(m + 1)? + 4| = 0, (2.1.32) 
or m = —2 and m = —1+ 2i. Therefore, the general solution is 
y(x) = Cie ?* + e * [Cs cos(2x) + C3 sin(2x)]. (2.1.33) 


Having presented the technique for solving constant coefficient, linear, ordinary differ- 
ential equations, an obvious question is: How do we know that we have captured all of the 
solutions? Before we can answer this question, we must introduce the concept of linear 
dependence. 


A set of functions fi(x), f2(z),..., fa (x) is said to be linearly dependent on an interval 
I if there exist constants C1, C5,..., C, not all zero, such that 
Ci fi(z) + C» f2(z) + Csfs(x) +- t Cufa(x) = 0 (2.1.34) 


for each x in the interval; otherwise, the set of functions is said to be linearly independent. 
This concept is easily understood when we have only two functions fi(x) and fa(x). If the 
functions are linearly dependent on an interval, then there exist constants C1 and C that 
are not both zero, where 

C4 fi (x) + C^ falx) =0 (2.1.35) 


for every x in the interval. If C1 Z 0, then 


file) = — faz). (2.1.36) 
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In other words, if two functions are linearly dependent, then one is a constant multiple of 
the other. Conversely, two functions are linearly independent when neither is a constant 
multiple of the other on an interval. 
e Example 2.1.6 

Let us show that f(a) = 2z, g(x) = 3x7, and h(x) = 5x — 82? are linearly dependent 
on the real line. 

To show this, we must choose three constants, C1, C5, and C3, such that 

C; f (x) + Cog(x) + Csh(x) = 0, (2.1.37) 


where not all of these constants are nonzero. A quick check shows that 


15f (a) — 16g(x) — 6h(x) = 0. (2.1.38) 


Clearly, f(x), g(x), and h(x) are linearly dependent. 


e Example 2.1.7 


This example shows the importance of defining the interval on which a function is 
linearly dependent or independent. Consider the two functions f(x) = x and g(x) = |z]. 
They are linearly dependent on the interval (0,00) since Cia + Co|a| = Cia + Cox = 0 
is satisfied for any nonzero choice of C1 and C5 where C4, = —C 2. What happens on the 
interval (—00,0)? They are still linearly dependent but now C1 = C. 


Although we could use the fundamental concept of linear independence to check and see 
whether a set of functions is linearly independent or not, the following theorem introduces 
a procedure that is very straightforward. 


Theorem: Wronskian Test of Linear Independence 


Suppose f(x), fo(x),...,fn(a) possess at least n — 1 derivatives. If the determinant? 


A fe bas fa 
fi Kx o som 
for“) fee“) " fe» 
is not zero for at least one point in the interval I, then the functions fi(x), fa(x), ..., fa (x) 


are linearly independent on the interval. 'The determinant in this theorem is denoted by 
WlUfi(z), fa(z),..., fa(z)] and is called the Wronskian of the functions. 


Proof: We prove this theorem by contradiction when n = 2. Let us assume that W [fı (xo), 
f2(xo)] # 0 for some fixed zo in the interval J and that fi(x) and fo(x) are linearly 
dependent on the interval. Since the functions are linearly dependent, there exists C4 and 
C2, both not zero, for which 

Cifi(x) + Cofo(x) = 0 (2.1.39) 


? If you are unfamiliar with determinants, see Section 3.2. 
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for every x in I. Differentiating Equation 2.1.39 gives 
C; fi (x) + Cofi(x) = 0. (2.1.40) 


We may view Equation 2.1.39 and Equation 2.1.40 as a system of equations with C4 and C2 
as the unknowns. Because the linear dependence of fı and f? implies that Cı 4 0 and/or 
Cz Æ 0 for each x in the interval, 


W[fi(z),fa()] - | Ë 


-[m go (2.1.41) 


for every x in J. This contradicts the assumption that W [fi (xo), f2(xo)] # 0 and fı and fo 
are linearly independent. 


e Example 2.1.8 


Are the functions f(x) = x, g(x) = xe”, and h(x) = z?e* linearly dependent on the 
real line? To find out, we compute the Wronskian or 


2 


e” xe” ger laze 
W (f(x), g(x), h(a)] =}e” (a+ le” (r?--2x)e | =e? |0 1 2g|= 2e £40. 
e* (r-2)e (a? + 4x + 2)e* 0 0 2 


(2.1.42) 


Therefore, x, xe”, and z?e* are linearly independent. 


Having introduced this concept of linear independence, we are now ready to address 
the question of how many linearly independent solutions a homogeneous linear equation 
has. 


Theorem: 


On any interval I over which an n-th order homogeneous linear differential equation is 
normal, the equation has m linearly independent solutions yi(x), yo(x),..., ua (x) and any 
particular solution of the equation on I can be expressed as a linear combination of these 
linearly independent solutions. 


Proof: Again for convenience and clarity we prove this theorem for the special case of n — 2. 
Let yi(a) and ys(x) denote solutions on I of Equation 2.1.2. We know that these solutions 
exist by the existence theorem and have the following values: 


yr(a)=1, yo(a)=0, yi(a)=0, h(a) =1 (2.1.43) 
at some point a on I. To establish the linear independence of yı and yo we note that, 
if Ciyi(x) + Coy2(x) = 0 holds identically on 7, then Cyy{(x) + Coy5(z) = 0 there too. 
Because x = a lies in I, we have that 


Cii (a) + C2y2(a) = 0, (2.1.44) 


and 


Cry; (a) + Coy5(a) = 0, (2.1.45) 
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which yields C4 = C$ = 0 after substituting Equation 2.1.43. Hence, the solutions yı and 
y» are linearly independent. 

To complete the proof we must now show that any particular solution of Equation 
2.1.2 can be expressed as a linear combination of y; and yo. Because y, yı, and ys are all 
solutions of Equation 2.1.2 on J, so is the function 


Y (a) = y(x) — y(a)yı (x) — v'(a)ux(2), (2.1.46) 


where y(a) and y'(a) are the values of the solution y and its derivative at x = a. Evaluating 
Y and Y' at x =a, we have that 


Y (a) = y(a) — y(a)yı (a) — vy (a)u2(a) = y(a) — y(a) = 0, (2.1.47) 
and 
Y'(a) = y'(a) — v(a)yi(a) — v'(a)us(a) = y'(a) — v'(a) = 0. (2.1.48) 
Thus, Y is the trivial solution to Equation 2.1.2. Hence, for every x in J, 
y(x) — y(a) (v) — y (a)us (a) = 0. (2.1.49) 
Solving Equation 2.1.49 for y(x), we see that y is expressible as the linear combination 
y(x) = y(a)yı (x) + v'(a)y(z) (2.1.50) 
of yı and y2, and the proof is complete for n = 2. 


Problems 


Find the general solution to the following differential equations. Check your general solution 
by using dsolve in MATLAB. 


1. y” + 6y' +5y =0 2. y" — 6y' + 10y=0 3. y" —2y +y =0 
4. y" — 3y' -2y =0 5. y" — 4y' + 8y = 0 6. y" + by! + 9y —0 
7. y” c 6y' -40y 20 — 8& y" c Ay + By =0 9. y"  8y' + 25y — 0 
10. 4y" — 12y -9y —0 11. y" +8y' + 16y — 0 12. y" + Ay" —0 

13. y" + Ay" =0 14. y" + 2y" + y" =0 15. y" — 8y —0 


16. y" = y" = 2y” —0 17. y" e 3y” ES 3y" o y — 0 18. y" Ay!" 6y" Ay! -y-0 
19. The simplest differential equation with “memory”— its past behavior affects the present 


A 


E K 


y = eT u(x) dz. 


Solve this integro-differential equation by differentiating it with respect to t to eliminate 
the integral. 
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Figure 2.2.1: Various configurations of a mass/spring system. The spring alone has a length L, which 
increases to L-- s when the mass is attached. During simple harmonic motion, the length of the mass/spring 
system varies as L + s + x. 


2.2 SIMPLE HARMONIC MOTION 


Second-order, linear, ordinary differential equations often arise in mechanical or elec- 
trical problems. The purpose of this section is to illustrate how the techniques that we just 
derived may be applied to these problems. 

We begin by considering the mass-spring system illustrated in Figure 2.2.1 where a 
mass m is attached to a flexible spring suspended from a rigid support. If there were 
no spring, then the mass would simply fall downward due to the gravitational force mg. 
Because there is no motion, the gravitational force must be balanced by an upward force 
due to the presence of the spring. This upward force is usually assumed to obey Hooke's 
law, which states that the restoring force is opposite to the direction of elongation and 
proportional to the amount of elongation. Mathematically the equilibrium condition can 
be expressed mg — ks. 

Consider now what happens when we disturb this equilibrium. This may occur in 
one of two ways: We could move the mass either upward or downward and then release 
it. Another method would be to impart an initial velocity to the mass. In either case, 
the motion of the mass/spring system would be governed by Newton's second law, which 
states that the acceleration of the mass equals the imbalance of the forces. If we denote the 
downward displacement of the mass from its equilibrium position by positive x, then 


m = —k(s + x) + mg = —ka, (2.2.1) 


since ks — mg. After dividing Equation 2.2.1 by the mass, we obtain the second-order 
differential equation 


ax k 

Gp t t=) (2.2.2) 
or d 

T +w?r = 0, (2.2.3) 


where w? = k/m and w is the circular frequency. Equation 2.2.3 describes simple harmonic 
motion or free undamped motion. The two initial conditions associated with this differential 
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Summary of Simple Harmonic Motion 


Displacement,x(t) 


A 
y. deci =0 


Maximum 
velocity 
/ - 
A Time, wr 
Phase 2€ 
Mere ee 


Period 


Amplitude, A 


! Initial / 
displacement 


2 \ 1/2 
x(t) = | 22+ 4) sin(wt + p) 


y —tan ! (=) ; vo = initial velocity 


equation are 


x(0) =a, x'(0) = £. (2.2.4) 


The first condition gives the initial amount of displacement while the second condition 
specifies the initial velocity. If a > 0 while 8 < 0, then the mass starts from a point below 
the equilibrium position with an initial upward velocity. On the other hand, if a < 0 with 
B = 0, the mass is at rest when it is released |a| units above the equilibrium position. 
Similar considerations hold for other values of a and f. 

To solve Equation 2.2.3, we note that the solutions of the auxiliary equation m?+w? = 0 
are the complex numbers mı = wi, and mg = —wi. Therefore, the general solution is 


x(t) = Acos(wt) + B sin(wt). (2.2.5) 
The (natural) period of free vibrations is T = 27/w while the (natural) frequency is f = 
1/T = w/(2r). 
e Example 2.2.1 


Let us solve the initial-value problem 
x j 
dB + 4x —0, x(0) = 10, x'(0) — 0. (2.2.6) 


'The physical interpretation is that we have pulled the mass on a spring down 10 units 
below the equilibrium position and then release it from rest at t = 0. Here, w = 2 so that 


x(t) = Acos(2t) + B sin(2t) (2.2.7) 


from Equation 2.2.5. 
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Because x(0) = 10, we find that 
z(0)—10— A-1-c- B. 0 (2.2.8) 


so that A = 10. Next, we note that 


e = —20sin(2t) + 2B cos(2t). (2.2.9) 
Therefore, at t = 0, 
z'(0) =0=-20-042B-1 (2.2.10) 


and B = 0. Thus, the equation of motion is z(t) = 10 cos(2t). 

What is the physical interpretation of our equation of motion? Once the system is set 
into motion, it stays in motion with the mass oscillating back and forth 10 units above and 
below the equilibrium position x = 0. The period of oscillation is 27/2 = m units of time. 


e Example 2.2.2 


A weight of 45 N stretches a spring 5 cm. At time t = 0, the weight is released from 
its equilibrium position with an upward velocity of 28 cm s71. Determine the displacement 
x(t) that describes the subsequent free motion. 

From Hooke's law, 

F=mg=45N=kx5cm (2.2.11) 


so that k = 9 N cm™!. Therefore, the differential equation is 


da 

—~ + 196s^?r = 0. 2.2.12 

dg c-196s "z —0 ( ) 
The initial displacement and initial velocity are z(0) = 0 cm and z'(0) = —28 cm s^!. The 


negative sign in the initial velocity reflects the fact that the weight has an initial velocity 
in the negative or upward direction. 
Because w? = 196 s^? or w = 14 s71, the general solution to the differential equation 
is 
a(t) = Acos(14s t) + Bsin(14s Ht). (2.2.13) 


Substituting for the initial displacement z(0) in Equation 2.2.13, we find that 


z(0)—0cm-— A-14- B-0, (2.2.14) 
and A — 0 cm. Therefore, 
a(t) = Bsin(14s H) (2.2.15) 
and 
z'(t) = 14s ! Bcos(14s t). (2.2.16) 


Substituting for the initial velocity, 
z'(0) = —28cms ! = 14s ! B, (2.2.17) 
and B — —2 cm. Thus the equation of motion is 


a(t) = —2cm sin(14s tt). (2.2.18) 
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Figure 2.2.2: Schematic of a floating body partially submerged in pure water. 


e Example 2.2.3: Vibration of floating bodies 


Consider a solid cylinder of radius a that is partially submerged in a bath of pure water 
as shown in Figure 2.2.2. Let us find the motion of this cylinder in the vertical direction 
assuming that it remains in an upright position. 

If the displacement of the cylinder from its static equilibrium position is x, the weight of 
water displaced equals Agp,z, where pw is the density of the water and g is the gravitational 
acceleration. This is the restoring force according to the Archimedes principle. The mass 
of the cylinder is Ahp, where p is the density of cylinder. From Newton’s second law, the 
equation of motion is 


pAhx" + Agpyx = 0, (2.2.19) 
i pug 
ES eS 2.2.2 
" 2h x=0. ( 0) 


From Equation 2.2.20 we see that the cylinder will oscillate about its static equilibrium 
position z = 0 with a frequency of 


1/2 
w= (5) l (2.2.21) 
ph 


When both A and B are nonzero, it is often useful to rewrite the homogeneous solution, 
Equation 2.2.5, as 
x(t) = Csin(wt + p) (2.2.22) 


to highlight the amplitude and phase of the oscillation. Upon employing the trigonometric 
angle-sum formula, Equation 2.2.22 can be rewritten 


x(t) = C sin(wt) cos(y) + C cos(wt) sin(y) = A cos(wt) + B sin(wt). (2.2.23) 

From Equation 2.2.23, we see that A = C'sin() and B = C cos(q). Therefore, 
A? + B? = C? sin? (p) + C? cos? (y) = C?, (2.2.24) 
and C = VA? + B?, Similarly, tan(y) = A/B. Because the tangent is positive in both the 
first and third quadrants and negative in both the second and fourth quadrants, there are 


two possible choices for y. The proper value of ọ satisfies the equations A = C'sin(y) and 
B = C cos(9). 
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If we prefer the amplitude/phase solution 
x(t) = C cos(wt — p), (2.2.25) 
we now have 
x(t) = C cos(wt) cos(y) + C sin(wt) sin(y) = Acos(wt) + B sin(wt). (2.2.26) 


Consequently, A = C'cos(y) and B = C sin(q). Once again, we obtain C = v A? + B?. On 
the other hand, tan(y) = B/A. 


Problems 


Solve the following initial-value problems and write their solutions in terms of amplitude 
and phase: 


1. x” + 25x = 0, x(0) = 10, z'(0) = —10 
2. Az" + 9x — 0, x(0) = 2m, z'(0) = 3« 
3. £” + xx — 0, x(0) — 1, z'(0) = n3 


4. A 4-kg mass is suspended from a 100 N/m spring. The mass is set in motion by giving it 
an initial downward velocity of 5 m/s from its equilibrium position. Find the displacement 
as a function of time. 


5. A spring hangs vertically. A weight of mass M kg stretches it L m. This weight is 
removed. A body weighing m kg is then attached and allowed to come to rest. It is then 
pulled down sp m and released with a velocity vo. Find the displacement of the body from 
its point of rest and its velocity at any time t. 


6. A particle of mass m moving in a straight line is repelled from the origin by a force 
F. (a) If the force is proportional to the distance from the origin, find the position of the 
particle as a function of time. (b) If the initial velocity of the particle is avk, where k is 
the proportionality constant and a is the distance from the origin, find the position of the 
particle as a function of time. What happens if m « 1 and m — 1? 


2.3 DAMPED HARMONIC MOTION 


Free harmonic motion is unrealistic because there are always frictional forces that act to 
retard motion. In mechanics, the drag is often modeled as a resistance that is proportional 
to the instantaneous velocity. Adopting this resistance law, it follows from Newton's second 
law that the harmonic oscillator is governed by 


dex dx 
m —-—kz Pan 


(2.3.1) 


where is a positive damping constant. The negative sign is necessary since this resistance 
acts in a direction opposite to the motion. 
Dividing Equation 2.3.1 by the mass m, we obtain the differential equation of free 
damped motion, 
dx bdr k 
di? ` 


= 2.3.2 
m dt m" 0, ( ) 
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Or 
dex dx 
—— + 2\— cx. 2.3.3 
Goa Qo) 
We have written 2A rather than just A because it simplifies future computations. The 
auxiliary equation is m? + 2Am + w? = 0, which has the roots 


mı =-A4+ Vr? -w?, and m3 = —A— Vr? —w?. (2.3.4) 


From Equation 2.3.4 we see that there are three possible cases which depend on the 
algebraic sign of A? — w?. Because all of the solutions contain the damping factor e-^', 


Aà > 0, x(t) vanishes as t — oo. 
e Case I: A >w 


Here the system is overdamped because the damping coefficient 3 is large compared to 
the spring constant k. The corresponding solution is 


x(t) = Ae"! + Berat, (2.3.5) 
or 
a(t) = e7% (Ae CA ety PEE) : (2.3.6) 


In this case the motion is smooth and nonoscillatory. 
e Case II: A — uw 


The system is critically damped because any slight decrease in the damping force would 
result in oscillatory motion. The general solution is 


r(t) = Ae™* + Bte™*, (2.3.7) 


or 
a(t) = e-**(A + Bt). (2.3.8) 


The motion is quite similar to that of an overdamped system. 
e Case Ill: A< w 


In this case the system is underdamped because the damping coefficient is small com- 
pared to the spring constant. The roots mı and ma are complex: 


mi--A-iVu?—X, and | mp = —A— iw? — X. (2.3.9) 
The general solution now becomes 


a(t) = e7 [Acos(t "m x) 4 Bsin(t/u? zi J l (2.3.10) 
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Figure 2.3.1: The displacement x(t) of a damped harmonic oscillator as a function of time and ¢ = A/w. 


Equation 2.3.10 describes oscillatory motion that decays as e~**. Equations 2.3.6, 2.3.8, and 
2.3.10 are illustrated in Figure 2.3.1 when the initial conditions are z(0) = 1 and z'(0) = 0. 

Just as we could write the solution for the simple harmonic motion in the ampli- 
tude/phase format, we can write any damped solution Equation 2.3.10 in the alternative 


form 
x(t) = Ce * sin(tv w2? — AM + e) ; (2.3.11) 


where C = A? + B? and the phase angle v is given by tan(y) = A/B such that A = 
Csin(y) and B = C cos(g). The coefficient Ce~™ is sometimes called the damped coefficient 
of vibrations. Because Equation 2.3.11 is not a periodic function, the quantity 2x / Vw? — A? 
is called the quasi period and Vw? — X? is the quasi frequency. The quasi period is the time 
interval between two successive maxima of x(t). 


e Example 2.3.1 


A body with mass m = i kg is attached to the end of a spring that is stretched 2 m 
by a force of 100 N. Furthermore, there is also attached a dashpot? that provides 6 N of 
resistance for each m/s of velocity. If the mass is set in motion by further stretching the 
spring i m and giving it an upward velocity of 10 m/s, let us find the subsequent motion. 

We begin by first computing the constants. The spring constant is k — (100 N)/(2 m) 
— 50 N/m. Therefore, the differential equation is 


zz" + 6a’ + 50r = 0 (2.3.12) 
with r(0) = $ m and z/(0) = —10 m/s. Here the units of x(t) are meters. The characteristic 
or auxiliary equation is 

m? + 12m + 100 = (m + 6)? + 64 = 0, (2.3.13) 


3 A mechanical device—usually a piston that slides within a liquid-filled cylinder—used to damp the 
vibration or control the motion of a mechanism to which it is attached. 
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Review of the Solution of the 
Underdamped Homogeneous Oscillator Problem 


mz" + Ba’ + ka = 0 subject to x(0) = zo, z'(0) = vo has the solution 
a(t) = Ae ^ sin(wat + q), 
where 


w = y k/m is the undamped natural frequency, 
= 8/(2m) is the damping factor, 


waq = Vw? — M is the damped natural frequency, 


and the constants A and y are determined by 


2 
diss " n (> +) 
Ud 


and 


or m = —6 + 8i. Therefore, we have an underdamped harmonic oscillator and the general 
solution is 
a(t) = e € [Acos(8t) + B sin(8t)]. (2.3.14) 
Consequently, each cycle takes 27/8 — 0.79 second. This is longer than the 0.63 second 
that would occur if the system were undamped. 
From the initial conditions, 


z(0-—A-1 


2? 


and z'(0)— —10— —6A + 8B. (2.3.15) 
Therefore, A = 4 and B = -í1. Consequently, 


a(t) = e 9' [1 cos(8t) — £ sin(8t)] = e 9' cos(8t + 2.62244). (2.3.16) 


v65 
8 


e Example 2.3.2: Design of a wind vane 


In its simplest form, a wind vane is a flat plate or airfoil that can rotate about a vertical 
shaft. See Figure 2.3.2. In static equilibrium it points into the wind. There is usually a 
counterweight to balance the vane about the vertical shaft. 

A vane uses a combination of the lift and drag forces on the vane to align itself with 
the wind. As the wind shifts direction from 0$ to the new direction 0;, the direction 0 in 
which the vane currently points is governed by the equation of motion? 

d0 NRd0 


I— NG dy, 2.3.17 
Ge a (i 6) ( ) 


4 For a derivation of Equation 2.3.12 and Equation 2.3.13, see subsection 2 of Section 3 in Barthelt, 
H. P., and G. H. Ruppersberg, 1957: Die mechanische Windfahne, eine theoretische und experimentelle 
Untersuchung. Beitr. Phys. Atmos., 29, 154-185. 
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Wind vector 


Vane 


Vertical axis of rotation bs 


Figure 2.3.2: Schematic of a wind vane. The counterbalance is not shown. 


where I is the vane's moment of inertia, N is the aerodynamic torque per unit angle, and 
R is the distance from the axis of rotation to the effective center of the aerodynamic force 
on the vane. The aerodynamic torque is given by 


N = 1CrpAV?R, (2.3.18) 
where Cz is the lift coefficient, p is the air density, A is the vane area, and V is the wind 
speed. 


Dividing Equation 2.3.17 by I, we obtain the second-order ordinary differential equation 


d(0-6)  NRd(9-0) | N 


dt? IV dt ra PM any) 
The solution to Equation 2.3.19 is 
NRt 
0 — bi = Ae ———— t 2.3.20 
ev(- 555 ) estet. (2.8.20) 
where iD 
N | N*R 
oed 2.3.21 
"TI App? RM) 


and A and y are the two arbitrary constants that would be determined by presently unspec- 
ified initial conditions. Consequently an ideal wind vane is a damped harmonic oscillator 
where the wind torque should be large and its moment of inertia should be small. 


Problems 


For the following values of m, 8, and k, find the position x(t) of a damped oscillator for the 
given initial conditions: 


l.m=}, 8-3, k=4, x(0)=2, 2/(0)=0 
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4. For an underdamped oscillator, show that the time required for its amplitude to drop 
to half of its original value equals In(2)/A. For a fixed value of A/w, what is the minimum 
number of cycles that has occurred? 


5. For what values of c does x” + ca’ + 4r = 0 have critically damped solutions? 


6. For what values of c are the motions governed by 4x” + ca’ + 9x = 0 (a) overdamped, 
(b) underdamped, and (c) critically damped? 


7. For an overdamped mass-spring system, prove that the mass can pass through its equi- 
librium position z — 0 at most once. 


2.4 METHOD OF UNDETERMINED COEFFICIENTS 


Homogeneous ordinary differential equations become nonhomogeneous when the right 
side of Equation 2.0.1 is nonzero. How does this case differ from the homogeneous one that 
we have treated so far? 

To answer this question, let us begin by introducing a function yj (r)—called a partic- 
ular solution—whose only requirement is that it satisfies the differential equation 


n—1 


as (x) Tw + an-ı(2) "ES Tec aae + ao(z)yp = f(x). (2.4.1) 


Then, by direct substitution, it can be seen that the general solution to any nonhomoge- 
neous, linear, ordinary differential equation is 


y(x) = yu (x) + Yp(7), (2.4.2) 
where yg (x)—the homogeneous or complementary solution—satisfies 


dyn 


di H ao(x)yg = 0. (2.4.3) 


T3 a(x) 


Why have we introduced this complementary solution? Because the particular solution 
already satisfies the ordinary differential equation. The purpose of the complementary 
solution is to introduce the arbitrary constants that any general solution of an ordinary 
differential equation must have. Thus, because we already know how to find yg (x), we 
must only invent a method for finding the particular solution to have our general solution. 


e Example 2.4.1 


Let us illustrate this technique with the second-order, linear, nonhomogeneous ordinary 
differential equation 
y" — Ay! + Ay = 2e?* + Ax — 12. (2.4.4) 


Taking y(x) = yn (x) + yp(x), direct substitution yields 
yin + ys — An + yh) + (yn + yp) = 2e7* + 4x — 12. (2.4.5) 
If we now require that the particular solution yp(x) satisfies the differential equation 


Yp — 4Yp + Ayp = 2e?” + 4x — 12, (2.4.6) 
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Equation 2.4.5 simplifies to the homogeneous ordinary differential equation 
yin — 4yy + Ayg = 0. (2.4.7) 


A quick check? shows that the particular solution to Equation 2.4.6 is yp(x) = x?e?* +x — 2. 
Using techniques from the previous section, the complementary solution is yg (£) = Cie?” + 
Core”. 


In general, finding y,(«) is a formidable task. In the case of constant coefficients, several 
techniques have been developed. The most commonly employed technique is called the 
method of undetermined coefficients, which is used with linear, constant coefficient, ordinary 
differential equations when f(x) is a constant, a polynomial, an exponential function e°”, 
sin(x), cos(Gx), or a finite sum and products of these functions. Thus, this technique 
applies when the function f(x) equals e? sin(x) — (3x — 2)e ^?" but not when it equals ln(z). 

Why does this technique work? The reason lies in the set of functions that we have 
allowed to be included in f(x). They enjoy the remarkable property that derivatives of 
their sums and products yield sums and products that are also constants, polynomials, 
exponentials, sines, and cosines. Because a linear combination of derivatives such as ayy + 
by, + cyp must equal f(x), it seems reasonable to assume that yp(x) has the same form as 
f(x). The following examples show that our conjecture is correct. 


e Example 2.4.2 


Let us illustrate the method of undetermined coefficients by finding the particular 
solution to 
y" — 2y' +y = x + sin(x). (2.4.8) 


From the form of the right side of Equation 2.4.8, we guess the particular solution 


yp(z) = Ax + B + C sin(x) + D cos(x). (2.4.9) 
Therefore, 
y, (x) = A + C cos(x) — D sin(x), (2.4.10) 
and 
yp (x) = —C sin(x) — D cos(x). (2.4.11) 


Substituting into Equation 2.4.8, we find that 
Yp — 2Yp + Yp = Az + B — 2A — 2C cos(x) + 2D sin(x) = x + sin(x). (2.4.12) 


Since Equation 2.4.12 must be true for all x, the constant terms must sum to zero or 
B — 2A = 0. Similarly, all of the terms involving the polynomial x must balance, yielding 
A= 1 and B = 2A = 2. Turning to the trigonometric terms, the coefficients of sin(x) and 
cos(x) give 2D = 1 and —2C = 0, respectively. Therefore, the particular solution is 


yp(x) = x +2 + $ cos(x), (2.4.13) 
and the general solution is 


y(x) = yx (x) + yp(x) = Cie* + Core” +x +2 + 4 cos(x). (2.4.14) 


5 We will show how yp(x) was obtained momentarily. 
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We can verify our result by using the symbolic toolbox in MATLAB. Typing the com- 
mand: 


dsolve(’D2y-2*Dyt+y=x+sin(x)’,’x’) 
yields: 


ans = 
x*2*1/2*cos (x) *C1*exp (x) +C2*exp (x) *x 


e Example 2.4.3 
Let us find the particular solution to 
y" 4 y' — 2y = xe” (2.4.15) 


by the method of undetermined coefficients. 
From the form of the right side of Equation 2.4.15, we guess the particular solution 


Yp(x) = Axe” + Be”. (2.4.16) 
Therefore, 
yp (x) = Axe? + Ae” + Be”, (2.4.17) 
and 
Yp (x) = Awe” + 2Ae* + Be”. (2.4.18) 


Substituting into Equation 2.4.15, we find that 
3Ae* = re”. (2.4.19) 


Clearly we cannot choose a constant A such that Equation 2.4.19 is satisfied. What went 
wrong? 
To understand why, let us find the homogeneous or complementary solution to Equation 
2.4.15; it is 
yn (x) = C1e 7* + Cre". (2.4.20) 


Therefore, one of the assumed particular solutions, Be”, is also a homogeneous solution 
and cannot possibly give a nonzero left side when substituted into the differential equation. 
Consequently, it would appear that the method of undetermined coefficients does not work 
when one of the terms on the right side is also a homogeneous solution. 

Before we give up, let us recall that we had a similar situation in the case of linear 
homogeneous second-order ordinary differential equations when the roots from the auxiliary 
equation were equal. There we found one of the homogeneous solutions was e":?, We 
eventually found that the second solution was xe™!*. Could such a solution work here? Let 
us try. 

We begin by modifying Equation 2.4.16 by multiplying it by x. Thus, our new guess 
for the particular solution reads 


yp(z) = Axe” + Bre”. (2.4.21) 


Then, 
y, = AL’ e” + 2Aze* + Bre” + Be”, (2.4.22) 
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and 
yp = Ar’ e” + AAze? + 24e? + Bre? + 2Be*. (2.4.23) 


Substituting Equation 2.4.21 into Equation 2.4.15 gives 
Yp + Yp — 2yp = 6Aze"^ + 2Ae” + 3Be* = re”. (2.4.24) 


Grouping together terms that vary as xe”, we find that 6A = 1. Similarly, terms that vary 
as e” yield 2A + 3B = 0. Therefore, 


yp(z) = ix?e* — tze”, (2.4.25) 
so that the general solution is 
y(z) = yn(z) + yp(x) = Cie 7^ + Cze” + Zr” — gae". 2.4.26 
p 6 9 


In summary, the method of finding particular solutions to higher-order ordinary differ- 
ential equations by the method of undetermined coefficients is as follows: 
e Step 1: Find the homogeneous solution to the differential equation. 


e Step 2: Make an initial guess at the particular solution. The form of y,(z) is a lin- 
ear combination of all linearly independent functions that are generated by repeated 
differentiations of f(x). 


e Step 3: If any of the terms in y,(x) given in Step 2 duplicate any of the homogeneous 
solutions, then that particular term in yp(x) must be multiplied by z^", where n is the 
smallest positive integer that eliminates the duplication. 

e Example 2.4.4 
Let us apply the method of undetermined coefficients to solve 


y" + y = sin(x) — e°” cos(5z). (2.4.27) 


We begin by first finding the solution to the homogeneous version of Equation 2.4.27: 


yg + yH =Q. (2.4.28) 
Its solution is 
ynu(x) = Acos(x) + B sin(x). (2.4.29) 


'To find the particular solution we examine the right side of Equation 2.4.27 or 
f(x) = sin(x) — e?” cos(5z). (2.4.30) 
Taking a few derivatives of f(a), we find that 
f'(x) = cos(x) — 3e?” cos(bz) + 5e?* sin(52), (2.4.31) 


f(z) = — sin(x) — 9e** cos(5x) + 30e?” sin(5z) + 25e?” cos(5z), (2.4.32) 


72 Advanced Engineering Mathematics with MATLAB 


and so forth. Therefore, our guess at the particular solution is 
yp(z) = Cz sin(x) + Dz cos(x) + Ee?” cos(5z) + Fe?” sin(5z). (2.4.33) 


Why have we chosen x sin(x) and xcos(r) rather than sin(x) and cos(x)? Because sin(x) 
and cos(r) are homogeneous solutions to Equation 2.4.27, we must multiply them by a 
power of x. 

Since 


y, (x) = 2C cos(x) — Cz sin(x) — 2D sin(x) — Da cos(x) 
+ (30F — 16E)e?* cos(5z) — (30E + 16F)e?* sin(52), (2.4.34) 


y, + yp = 2C cos(x) — 2D sin(x) 
+ (30F — 15E)e?* cos(5z) — (30E + 15F)e?* sin(bz) (2.4.35) 
= sin(x) — e?” cos(5z). (2.4.36) 


Therefore, 2C = 0, —2D = 1, 30F — 15E = —1, and 30E + 15F = 0. Solving this system 


of equations yields C — 0, D — -i, E = z5 and F = -4. 'Thus, the general solution is 


y(x) = Acos(x) + Bsin(x) — 1x cos(x) + +e” [cos(5z) — 2sin(5z)]. (2.4.37) 


Problems 


Use the method of undetermined coefficients to find the general solution of the following 
differential equations. Verify your solution by using dsolve in MATLAB. 


1. y" - Ay -3y 2 z 4-1 2. y” —y =e” — 2e ?? 

3. y" + 2y' + 2y = 2x? +2244 4. y' +y =x? +2 

5. y" -2y' = 2g + 5— e ?7 6. y” — Ay' + 4y = (x + 1)e?* 
T. y” + Ay! + 4y = re” 8. y" — 4y = 4sinh(2z) 

9. y" + 9y = z cos(3x) 10. y" + y = sin(x) + z cos(x) 
11. Solve 


y'--2ay = sin? (wr),  y(0) = y'(0) = 0, 


by (a) the method of undetermined coefficients and (b) integrating the ordinary differential 
equation so that it reduces to 


x  sin(2ar) 


H2 = ; 
aia N^: 4a 


and then using the techniques from the previous chapter to solve this first-order ordinary 
differential equation. 


Higher-Order Ordinary Differential Equations 73 


2.5 FORCED HARMONIC MOTION 


Let us now consider the situation when an external force f(t) acts on a vibrating mass 
on a spring. For example, f(t) could represent a driving force that periodically raises and 
lowers the support of the spring. The inclusion of f(t) in the formulation of Newton’s second 
law yields the differential equation 


dx dx 
ma = —kz Ba + f(t), (2.5.1) 
dr Bde k f(t) 

+ = 2.5.2 
d? "md m. m ' eee) 
or $5 É 

z fag UEM 

dg 4 2A Ji wa = F(t), (2.5.3) 


where F(t) = f(t)/m, 24 = B/m, and w? = k/m. To solve this nonhomogeneous equation 
we will use the method of undetermined coefficients. 


e Example 2.5.1 
Let us find the solution to the nonhomogeneous differential equation 
y" +2y' +y = 2sin(t), (2.5.4) 


subject to the initial conditions y(0) = 2 and y'(0) = 1. 
'The homogeneous solution is easily found and equals 


yu(t) = Ae’ + Bte™. (2.5.5) 


From the method of undetermined coefficients, we guess that the particular solution is 


Yp(t) = C cos(t) + D sin(t), (2.5.6) 
so that 
y, (t) = —C sin(t) + D cos(t), (2.5.7) 
and 
y, (t) = —C cos(t) — Dsin(t). (2.5.8) 


Substituting yp(t), v; (t), and yj(t) into Equation 2.5.4 and simplifying, we find that 
—2C sin(t) + 2D cos(t) = 2sin(t) (2.5.9) 


or D — 0 and C= —1. 
To find A and B, we now apply the initial conditions on the general solution 


y(t) = Ae™ + Bte * — cos(t). (2.5.10) 
The initial condition y(0) — 2 yields 


y(0) =A+0-1=2, (2.5.11) 
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or A = 3. The initial condition y'(0) = 1 gives 
y(0)=-A+B=1, (2.5.12) 


or B = 4, since 


y (t) = —Ae™ + Be™ — Bte™ + sin(t). (2.5.13) 


Therefore, the solution that satisfies the differential equation and initial conditions is 


y(t) = 3e^* + 4te~* — cos(t). (2.5.14) 


e Example 2.5.2 


Let us solve the differential equation for a weakly damped harmonic oscillator when 
the constant forcing Fo “turns on" at t = to. The initial conditions are that z(0) = xo and 
x’ (0) = vo. Mathematically, the problem is 


0, 0<t< to, 


Mu n (2.5.15) 


z" + 2Ax! +w r = { 


with z(0) = zo and z'(0) = vo. 
To solve Equation 2.5.15, we first divide the time domain into two regions: 0 « t « to 
and to < t. For 0 < t < to, 


a(t) = Ae~™ cos(wat) + Be~™ sin(wat), (2.5.16) 
where w2 = w? — M. Upon applying the initial conditions, 


X VO + Azo e 


t cos(wat) + 
Ud 


x(t) = zoe” sin(wqt), (2.5.17) 


as before. 
For the region tọ < t, we write the general solution as 


Fi 
x(t) = Ae cos(wgt) + Be-* sin(wgt) + = 
Ww 
+ Ce") cos[walt — t9)] + De") sin[wa(t — to)]. (2.5.18) 


Why have we written our solution in this particular form rather than the simpler 
—At —Atq Fo 
x(t) = Ce ^" cos(wat) + De ^" sin(wat) + —5? (2.5.19) 
w 
Both solutions satisfy the differential equation, as direct substitution verifies. However, the 
algebra is greatly simplified when Equation 2.5.18 rather than Equation 2.5.19 is used in 
matching the solution from each region at t = to. There, both the solution and its first 


derivative must be continuous or 


sic edm and. .w'ü)es'( (2.5.20) 
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Review of the Solution of the 
Forced Harmonic Oscillator Problem 


The undamped system mz" +kx = Fo cos(wot) subject to the initial conditions z(0) = 
zo and z'(0) = vo has the solution 


x(t) = T sin(wt) 4 (s za) cos(wt) + ENT cos(wot), 


where fo = Fo/m and w = 4/k/m. The underdamped system mz" + Ba! + ka = 
Fo cos(wot) has the steady-state solution 


* fo sl aces dass (zs) | 
ae V (w? — wig)? + Quo)? "T Z um (ae wo) |’ 


where 2\ = b/m. 


where tj and [^ are points just below and above to, respectively. When Equation 2.5.17 
and Equation 2.5.18 are substituted, we find that C = —Fo/w?, and w4D = AC. Thus, the 
solution for the region to < t is 


A F, 
r(t) = ae cos(wat) + 29 29 eM sin(wat) + -2 (2.5.21) 
Wd Ww 
Fi AR 
L eTAto) cosjwalt — 53] es eh sinjwalt — to)]. 


wqu? 


In a book that treats Laplace transforms, you will see that they are particularly useful for 
this type of problem when the forcing function changes abruptly one or more times. 


As noted earlier, nonhomogeneous solutions consist of the homogeneous solution plus 
a particular solution. In the case of a damped harmonic oscillator, another, more physical, 
way of describing the solution involves its behavior over an extended time. That portion 
of the solution which eventually becomes negligible as t — oo is often referred to as the 
transient term, or transient solution. In Equation 2.5.14 the transient solution equals 
3e^* + 4te~*. On the other hand, the portion of the solution that remains as t — oo is 
called the steady-state solution. In Equation 2.5.14 the steady-state solution equals — cos(t). 


One of the most interesting forced oscillator problems occurs when £8 = 0 and the 
forcing function equals Fo sin(wot), where Fo is a constant. Then the initial-value problem 
becomes 

dr 2 ] 
E +wx = Fosin(wot). (2.5.22) 
Let us solve this problem when x(0) = z'(0) = 0. 
The homogeneous solution to Equation 2.5.22 is 


xj (t) = Acos(wt) + Bsin(wt). (2.5.23) 
To obtain the particular solution, we assume that 


zy (t) = Ccos(wot) + D sin(wot). (2.5.24) 
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Figure 2.5.1: The solution, Equation 2.5.31, as a function of time when w = 1 and wo equals (a) 1.02, (b) 
1.2, and (c) 2 


This leads to 


a, (t) = —Cwo sin(wot) + Duo cos(wot), (2.5.25) 
x} (t) = —Cug cos(wot) + Dug sin(wot), (2.5.26) 
and 
x! + wrp = C(w? — wa) cos(wot) + D(w? — wê) sin(wot) = Fo sin(wot). 2.5.27 
p P 0 0 


We immediately conclude that C(w? — w2) = 0, and D(w? — wk) = Fo. Therefore, 


C=0 d D -———3 2.5.28 
(oam ag (2.5.28) 
provided that w 4 wo. Thus, 
Fi 
ap(t) = =—— sin(wot). (2.5.29) 
w? — wá 


'To finish the problem, we must apply the initial conditions to the general solution 


F 
a(t) = Acos(wt) + B sin(wt) + — ——; sin(wot). (2.5.30) 
— QJ 


2 
w 0 


From x(0) = 0, we find that A = 0. On the other hand, x’(0) = 0 yields B = —woFo/[w(w?— 
w¢)|. Thus, the final result is 


x(t) = ee [w sin(wot) — wo sin(wt)] . (2.5.31) 
ww? — wg) 


Figure 2.5.1 illustrates Equation 2.5.31 as a function of time. 
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The most arresting feature in Figure 2.5.1 is the evolution of the uniform amplitude 
of the oscillation shown in frame (c) into the one shown in frame (a) where the amplitude 
exhibits a sinusoidal variation as wo — w. In acoustics these fluctuations in the amplitude 
are called beats, the loud sounds corresponding to the larger amplitudes. 

As our analysis indicates, Equation 2.5.31 does not apply when w = wo. As we shall 
shortly see, this is probably the most interesting configuration. We can use Equation 2.5.31 
to examine this case by applying L’Hopital’s rule in the limiting case of wọ — w. This 
limiting process is analogous to “tuning in” the frequency of the driving frequency [wo/(27)] 
to the frequency of free vibrations [w/(27)]. From experience, we expect that given enough 
time we should be able to substantially increase the amplitudes of vibrations. Mathematical 
confirmation of our physical intuition is as follows: 


c) sin(wot) — wo sin(wt) d[w sin(wot) — wo sin(wt)]/dwo 


t)= lim fF = Fi 2.5.32 
dU CET ema) oo su d[w(w2 — vw] /duo (2092) 
E NUS wt cos(wot) — sin(wt) 2 p cos(wt) — sin(wt) (2.5.33) 
wow —2Qwow —2w? 
Po. Fot 
= 5,52 sin(wt) pu Ow cos(wt). (2.5.34) 


As we suspected, as t — oo, the displacement grows without bounds. This phenomenon is 
known as pure resonance. We could also have obtained Equation 2.5.34 directly using the 
method of undetermined coefficients involving the initial value problem 

dex 


mh wg = Fosin(wt),  æ(0) = z'(0) = 0. (2.5.35) 


Because there is almost always some friction, pure resonance rarely occurs and the 
more realistic differential equation is 


d d 
TS + 277 + wx = Fy sin(wot). (2.5.36) 


Its solution is 


Fi 
x(t) = Ce-* sin(1 w? — we 4 ) | sin(wot — 0), 2.5.37 
(t Vaito) + eg oe) Gsm 


0 


2AWo wu? — we 


sin(8) = Wena eae cos(0) = Tena ee 


(2.5.38) 


and C and ọ are determined by the initial conditions. To illustrate Equation 2.5.37 we 
rewrite the amplitude and phase of the particular solution as 


Fo i Fo 
J (w? — we)? +4)\2we w? vi — r2? + AB?r? 


and tan(0) — M 


5, (2.5.39) 
Laid 


where r = wo/w and 8 = A/w. Figures 2.5.2 and 2.5.3 graph Equation 2.5.37 as functions 
of r for various values of f. 
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Figure 2.5.2: The amplitude of the particular solution Equation 2.5.37 for a forced, damped simple 
harmonic oscillator (normalized with Fo/w?) as a function of r = wo/w. 


e Example 2.5.3: Electrical circuits 


In the previous chapter, we saw how the mathematical analysis of electrical circuits 
yields first-order linear differential equations. In those cases we only had a resistor and 
capacitor or a resistor and inductor. One of the fundamental problems of electrical circuits 
is a circuit where a resistor, capacitor, and inductor are connected in series, as shown in 
Figure 2.5.4. 

In this RCL circuit, an instantaneous current flows when the key or switch K is closed. 
If Q(t) denotes the instantaneous charge on the capacitor, Kirchhoff's law yields the differ- 
ential equation 


dI Q 
L— + RI 4- 4 = E(t 2.5.40 
ot E+ = EQ) (2.5.40) 
where E(t), the electromotive force, may depend on time, but where L, R, and C are 


constant. Because I = dQ/dt, Equation 2.5.40 becomes 


PQ, ydQ 


Q 
dt? VU m 


L 
dt C 


E(t). (2.5.41) 


Consider now the case when resistance is negligibly small. Equation 2.5.41 will become 
identical to the differential equation for the forced simple harmonic oscillator, Equation 
2.5.3, with A = 0. Similarly, the general case yields various analogs to the damped harmonic 
oscillator: 


Case 1 Overdamped R? >4L/C 
Case 2 Critically damped R? =4L/C 
Case 3 Underdamped R? < 4L/C 


In each of these three cases, Q(t) — 0 as t — oo. (See Problem 7.) Therefore, an RLC 
electrical circuit behaves like a damped mass-spring mechanical system, where inductance 
acts like mass, resistance is the damping coefficient, and 1/C is the spring constant. 
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Figure 2.5.3: The phase of the particular solution, Equation 2.5.37, for a forced, damped simple harmonic 
oscillator as a function of r = wo/w. 
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Figure 2.5.4: A simple electrical circuit containing a resistor of constant resistance R, capacitor of constant 
capacitance C, and inductor of constant inductance L driven by a time-dependent electromotive force E(t). 


Problems 
1. Find the values of y so that x" + 6x’ + 18 = cos(7t) is in resonance. 


2. The differential equation x" + 2a’ + 2x = 10sin(2t) describes a damped, forced oscillator. 
If the initial conditions are z(0) = xo and z'(0) = 0, find its solution by hand and by using 
MATLAB. Plot the solution when zp = —10, —9,...,9,10. Give a physical interpretation to 
what you observe. 


3. At time t = 0, a mass m is suddenly attached to the end of a hanging spring with a 
spring constant k. Neglecting friction, find the subsequent motion if the coordinate system 
is chosen so that z(0) = 0. 


Step 1: Show that the differential equation is mz" + kx = mg with the initial conditions 
x(0) = z'(0) = 0. 
Step 2: Show that the solution to Step 1 is x(t) = mg [1 — cos(wt)] /k where w? = k/m. 


4. At what driving frequency does a forced, damped, simple harmonic oscillator have 
its maximum amplitude? At what driving frequency does the velocity have its maximum 
amplitude? 


5. Consider the electrical circuit shown in Figure 2.5.4, which now possesses negligible 
resistance and has an applied voltage E(t) = Eo[1—cos(wt)]. Find the current if the circuit 
is initially dead. 
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6. Find the general solution to the differential equation governing a forced, damped har- 
monic equation mz" + cx! + kx = Fo sin(wt), where m, c, k, Fo, and w are constants. Write 
the particular solution in amplitude/phase format. 


7. Prove that the transient solution to Equation 2.5.41 tends to zero as t > oo if R, C, and 
L are greater than zero. 


2.6 VARIATION OF PARAMETERS 


As the previous section has shown, the method of undetermined coefficients can be 
used when the right side of the differential equation contains constants, polynomials, expo- 
nentials, sines, and cosines. On the other hand, when the right side contains terms other 
than these, variation of parameters provides a method for finding the particular solution. 

To understand this technique, let us return to our solution of the first-order ordinary 
differential equation 


— + P(x)y = f (x). (2.6.1) 


Its solution is 
yay esque redu eroe fef P(2) de Fn) der. (2.6.2) 


The solution, Equation 2.6.2, consists of two parts: The first term is the homogeneous 


solution and can be written yg (x) = Ciyi(z), where yi (x) = e` J PŒ) 4 The second term 
is the particular solution and equals the product of some function of x, say u(x), times 
yı (z): 

mla) =e PPM [ SPOE Fa) ds = ui Gr) (2). (2.6.3) 


This particular solution bears a striking resemblance to the homogeneous solution if we 
replace u(x) with C1. 

Variation of parameters builds upon this observation by using the homogeneous solution 
yı (x) to construct a guess for the particular solution y,(x) = uı(x)yı (x). Upon substituting 
this guessed y,(a) into Equation 2.6.1, we have that 


d 
dz n) + P(zyui = F(x), (2.6.4) 
"EA + T + P(xjuiyı = f(x), (2.6.5) 
or F 
nm = f(z), (2.6.6) 


since y, + P(x)y1 = 0. 
Using the technique of separating the variables, we have that 


and ui(x) = an dz. (2.6.7) 


Consequently, the particular solution equals 


yp(x) = u (x) (x) = nt f fm (2.6.8) 
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Upon substituting for yı (x), we obtain Equation 2.6.3. 
How do we apply this method to the linear second-order differential equation 


a» (z)y" + aiy’ (x) + ao(x)y = g(x), (2.6.9) 
or 
y” + P(z)y + Q(x)y = f(x). (2.6.10) 


where P(x), Q(x), and f(x) are continuous on some interval 7? 
Let yi(x) and ys(x) denote the homogeneous solutions of Equation 2.6.10. That is, 
y1(x) and yo(a) satisfy 


yi + P(x)y, + Q(z)yi = 0, (2.6.11) 
and 
y» + P(z)y5 + Q(x)y» = 0. (2.6.12) 


Following our previous example, we now seek two functions u(x) and u»(x) such that 


yp(x) = uy (x)y1 (£) + us(x)yo() (2.6.13) 


is a particular solution of Equation 2.6.10. Once again, we replaced our arbitrary constants 
Cı and C3 by the “variable parameters” u;(x) and u(x). Because we have two unknown 
functions, we require two equations to solve for u(x) and us(x). One of them follows from 
substituting yp(r) = ui(z)yi(x) + u2(x)y2(x) into Equation 2.6.10. The other equation is 


yi Gr)us (2) + ye(2)u (2) — 0. (2.6.14) 


This equation is an assumption that is made to simplify the first and second derivative, 
which is clearly seen by computing 


Yp = Uy, + giu, + uays + yaus = ury + uay», (2.6.15) 


after applying Equation 2.6.14. Continuing to the second derivative, 


Yp = Uy] + us + uayy + yous. (2.6.16) 
Substituting these results into Equation 2.6.10, we obtain 


y, + P(x)y, + Q(x) yp = uy? + yy + uzys + your 


+ Pury, + Puy; + Quiyi + Quays, (2.6.17) 
= u [yy + P(x)ys + Q(x) yi] + u2 [y2 + P(z)u5 + Q(x) y2] 
+ yiu, + yu, = f(x). (2.6.18) 


Hence, ui(r) and uz(x) must be functions that also satisfy the condition 
yyuy + you» = f(x). (2.6.19) 
It is important to note that the differential equation must be written so that it conforms to 


Equation 2.6.10. This may require the division of the differential equation by a»(x) so that 
you have the correct f(x). 
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Equations 2.6.14 and 2.6.19 constitute a linear system of equations for determining the 
unknown derivatives u) and us. By Cramer’s rule,? the solutions of Equation 2.6.14 and 
Equation 2.6.19 equal 


ui (x) = W^ and u(x) = Wo (2.6.20) 
where 
W = A 925 w =| ddl. dad Wee 2 l (2.6.21) 
Yı Y2 f(z) w yı f(z) 


The determinant W is the Wronskian of yı and y2. Because yı and y2 are linearly indepen- 
dent on J, the Wronskian will never equal zero for every x in the interval. 
'These results can be generalized to any nonhomogeneous, nth-order, linear equation of 
the form 
y + Pra(a)y + Py(a)y! + Po(a) = f(a). (2.6.22) 


If yg (x) = Ciyi(x) + Coya(x) +-+++ Cryn(x) is the complementary function for Equation 
2.6.22, then a particular solution is 


Yp(x) = ui (x)y (x) + us ()ya (a) + +++ + Un(@)yn(2), (2.6.23) 
where the u}, k = 1,2,...,n, are determined by the n equations: 
yiul, + yout: ++ ya ul, — 0, (2.6.24) 
yis + you os sus = 0, (2.6.25) 
Vr Dus yy Duy byl Du, = f(2). (2.6.26) 


The first n — 1 equations in this system, like Equation 2.6.14, are assumptions made to 
simplify the first n — 1 derivatives of yp(x). The last equation of the system results from 
substituting the n derivative of yp(x) and the simplified lower derivatives into Equation 
2.6.22. Then, by Cramer's rule, we find that 


k —1,2 


— Mes 2.6.27 
W , , ? ? , ( ) 


dr 


where W is the Wronskian of yi, ys, ...., Yn, and Wọ is the determinant obtained by replacing 
the kth column of the Wronskian by the column vector [0,0,0, ---, f(z)]*. 


e Example 2.6.1 
Let us apply variation of parameters to find the general solution to 
y” +y —2y = re”. (2.6.28) 
We begin by first finding the homogeneous solution that satisfies the differential equa- 


tion 
Vi t Vg —2yg =0. (2.6.29) 


6 If you are unfamiliar with Cramer's rule, see Section 3.3. 


Higher-Order Ordinary Differential Equations 83 


Applying the techniques from Section 2.1, the homogeneous solution is 
yg(z) = Ae* + Be ?*, (2.6.30) 


yielding the two independent solutions y1(x) = e”, and ya(x) = e ?*. Thus, the method of 
variation of parameters yields the particular solution 


yp(z) = u(x) + e?" ux(z). (2.6.31) 


From Equation 2.6.14, we have that 


eu (x) +e 7" u(z) = 0, (2.6.32) 
while 
eul (x) — 2e-?* ul, (x) = ze”. (2.6.33) 


Solving for u(x) and u5(a), we find that 
uj(z) = iz, or wi) eed (2.6.34) 


and 
u5(z)- —ize?, or u2(x) = 3; (1 — 3a)e**. (2.6.35) 


Therefore, the general solution is 


y(x) = Ae* + Be~** + e*uj(z) + e ?*us(z) (2.6.36) 
= Ae” + Be ?* + ig?e* + L(1— 3z)e* (2.6.37) 
= Ce? + Be~** + (4a? — Ix) e. (2.6.38) 


e Example 2.6.2 
Let us find the general solution to 
y" +2y’+y=e *In(z) (2.6.39) 


by variation of parameters on the interval (0, oc). 
We start by finding the homogeneous solution that satisfies the differential equation 


yn *2yg + yn = 0. (2.6.40) 
Applying the techniques from Section 2.1, the homogeneous solution is 
yH(x) = Ae * + Bre”, (2.6.41) 


yielding the two independent solutions yı (x) = e7” and y2(x) = xe *. Thus, the particular 
solution equals 
yp(z) =e u(x) + ze ^us(x). (2.6.42) 


From Equation 2.6.14, we have that 


e "uj (x) + ze "us(r) = 0, (2.6.43) 
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while 
—e u) (x) + (1— z)e *us(x) = e * ln(x). (2.6.44) 


Solving for uj (x) and u5(r), we find that 
u (x) = —xIn(z), or u(x) = fa? — x? ln(x), (2.6.45) 


and 
tis (0) = ln(x), or u»(x) = zln(x) — x. (2.6.46) 
'Therefore, the general solution is 


y(x) = Ae~* + Bze * te ^uy(x) + ze *ux(a) (2.6.47) 
= Ae * + Bze * + ia?ln(z)e * — S27, (2.6.48) 


We can verify our result by using the symbolic toolbox in MATLAB. Typing the com- 
mand: 


dsolve(?D2y42*Dy*y-exp(-x)*log(x)? ,?x?) 
yields: 


ans = 
1/2*exp (-x) *x*2*log (x) -3/4*exp (-x) *x*2+C1*exp (-x) +C2*exp (-x) *x 


e Example 2.6.3 


So far, all of our examples have yielded closed-form solutions. To show that this is not 
necessarily so, let us solve 
y” — 4y = e [a (2.6.49) 


by variation of parameters. 
Again we begin by solving the homogeneous differential equation 


yin — 4yH — 0, (2.6.50) 


which has the solution 
yu(x) = Ae” + Be ?*, (2.6.51) 


2x 


Thus, our two independent solutions are yi(r) = e?" and yo(x) = e^?". Therefore, the 


particular solution equals 


yp (x) = eu, (v) + e ?*us(a). (2.6.52) 
From Equation 2.6.14, we have that 
e" ui (x) +e 77 ut, (x) = 0, (2.6.53) 
while 
2e7" ul (x) — 2e7*7 uh (x) = e?* [g. (2.6.54) 
Solving for uj (x) and u5(a), we find that 
1 
ui (£) = — or u(x) = 41n |æ], (2.6.55) 
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and 
A et? i x ett 
Ug (x) = E Or u»(a) =g a E dt. (2.6.56) 
'Therefore, the general solution is 
y(x) = Ae?* + Be” + e?*u (y) + e ?* uj (a) (2.6.57) 
x At 
= Ae? + Be~** + 1 In |ale?” — e f — dt. (2.6.58) 
xo 


Problems 


Use variation of parameters to find the general solution for the following differential equa- 
tions. Then see if you can obtain your solution by using dsolve in MATLAB. 


1. y” — 4y' + 3y = e^? 2.y"—y —2y—r 3. y" — 4y = xe” 

4. y" -- 9y = 2sec(z) 5. y" + 4y' + Ay = ze 7? 6. y" + 2ay! = sin? (wa) 

7. y" — Ay! + 4y = (a + Le?” 8. y" — 4y = sin? (x) 9. y" — 2y’ +y = e* fx 

10. y" + y = tan(x) 11. y" — Ay' + 3y = 2cos(z + 3) 12. y" — 3y' + 2y = cos(e 7) 


2.7 EULER-CAUCHY EQUATION 


'The Euler-Cauchy or equidimensional equation is a linear differential equation of the 
form 


d^ _, qr! d 
ana” T + Oye” ee eee aes + aoy = f(x), (2.7.1) 
where an, Gn—1, ..., ag are constants. The important point here is that in each term the 


power to which x is raised equals the order of differentiation. 
'To illustrate this equation, we will focus on the homogeneous, second-order, ordinary 
differential equation 
Py ag ae ee (2.7.2) 
ar y T rd. T. 
The solution of higher-order ordinary differential equations follows by analog. If we wish to 


solve the nonhomogeneous equation 


d? d 
TEE + be + cy = f(e), (2.7.3) 


we can do so by applying variation of parameters using the complementary solutions that 
satisfy Equation 2.7.2. 

Our analysis starts by trying a solution of the form y = z", where m is presently 
undetermined. The first and second derivatives are 


dy = m-i dy 


pa Am = m-—2 
x: , and di m(m — 1)x 3 (2.7.4) 
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respectively. Consequently, substitution yields the differential equation 


: d 
ax + be + cy = az? - m(m — 1)z 7? + bz -ma™ + ez" (2.7.5) 
= am(m — 1)a™ + bma™ + cx” (2.7.6) 
= [am(m — 1) + óm + c] z^". (2.7.7) 


Thus, y = xz" is a solution of the differential equation whenever m is a solution of the 
auxiliary equation 


am(m — 1) -- bm 4 c — 0, or am? + (b—a)m+c=0. (2.7.8) 


At this point we must consider three different cases that depend upon the values of a, b, 
and c. 


e Distinct real roots 
Let m; and m» denote the real roots of Equation 2.7.8 such that mı Æ m2. Then, 
y(r) =x and ya(x) = x"? (2.7.9) 


are homogeneous solutions to Equation 2.7.2. Therefore, the general solution is 


e Repeated real roots 


If the roots of Equation 2.7.8 are repeated [m = ma = —(b — a)/2], then we presently 
have only one solution, y = z™!. To construct the second solution yo, we use reduction in 
order. We begin by first rewriting the Euler-Cauchy equation as 


dy b dy c 


= 0. 2.7.11 
de? axdx | ax?” ( ) 
Letting P(x) = b/(ax), we have 
e7 J I/(a2] da e- (b/a) In(a) 
yo(x) = g™ / A oe dx = aq" l De dx (2.7.12) 
Sgt Justi dass sp eves dx (2.7.13) 
T / 2 = q^ ]n(z). (2.7.14) 
'The general solution is then 
y(x) = Ciz" + Coz"" In(z). (2.7.15) 


For higher-order equations, if mı is a root of multiplicity k, then it can be shown that 


za In(x), 2 [In(z)]?, ... , z"* [In(z)]|^! 
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are the k linearly independent solutions. Therefore, the general solution of the differential 
equation equals a linear combination of these k solutions. 


e Conjugate complex roots 


If the roots of Equation 2.7.8 are the complex conjugate pair mı = a 4- iB, and ms = 
a — iB, where a and f are real and 6 > 0, then a solution is 


y(z) = Cirt? 4 Cyne? (2.7.16) 
However, because 2/9 = [el (229 = etle), we have by Euler’s formula 
x? = cos[#In(a)| + isin[OIn(x)], and z-/? = cos[Qln(z) —isin[@In(x)}. — (2.7.17) 
Substitution into Equation 2.7.16 leads to 
y(x) = C3x° cos[6 1n(z)] + Caz? sin[B In(x)] , (2.7.18) 
where C3 = C, + C5, and C4 = iC, — iC 2. 
e Example 2.7.1 
Let us find the general solution to 
z^y" + 5zy' — 12y = ln(x) (2.7.19) 
by the method of undetermined coefficients and variation of parameters. 
In the case of undetermined coefficients, we begin by letting t = In(x) and y(x) = Y (t). 
Substituting these variables into Equation 2.7.19, we find that 
Y" + 4Y' — 12Y =t. (2.7.20) 
'The homogeneous solution to Equation 2.7.20 is 
Yu(t) = A'e% + B'e”, (2.7.21) 


while the particular solution is 
Y,(t) = Ct+ D (2.7.22) 


from the method of undetermined coefficients. Substituting Equation 2.7.22 into Equation 


2.7.20 yields C = -5 and D = — 35. Therefore, 


Y(t) = A'e + B'e” — bt- i. or y(x)= "E Ba? — $ ln(x)— d. (2.723) 


'To find the particular solution via variation of parameters, we use the homogeneous 
solution 


A 
yu (z) = ae Ba? (2.7.24) 
to obtain yı (x) = z^? and ya(x) = z?. Therefore, 


yp(z) = x u(x) + z^ux(z). (2.7.25) 
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Substitution of Equation 2.7.25 in Equation 2.7.19 yields the system of equations: 
z 9uj(z)--a?u(z) —-0, and — 6x 'wj(x)--2xu)(x) = In(z)/z?. (2.7.26) 


Solving for u4 (x) and u5(x), 


ui (a) = UE M and — uj(z)- D (2.7.27) 
The solutions of these equations are 
u(x) = EE ae) + rd and U2(x) = ee — T (2.7.28) 
'The general solution then equals 
A 2 | n6 2 A 2.3 1 
y(x) = 76 + Bar x Pus(x) + 27u2(x) = ze Bg" Inr — z5 (2.7.29) 


We can verify this result by using the symbolic toolbox in MATLAB. Typing the com- 
mand: 


dsolve(^x^2*D2y*b*x*Dy-12*y-log(x)?,?x?) 
yields: 


ans = 
-1/12*1og()-1/364C1*x^24C2/x^6 


Problems 


Find the general solution for the following Euler-Cauchy equations valid over the domain 
(—00,00). Then check your answer by using dsolve in MATLAB. 


1. z2y" -zy/ —y —0 2. xy" + 2ry’ — 2y =0 3. z?y" — 2y =0 
4. z?y" — zy' +y=0 5. xy" + 3ry' +y =0 6. z?y" — 3xy' + 4y =0 
7. z?y" — y -5y =0 8. 42?y" + 8ry' + 5y =0 9. z?y" + zy +y=0 


10. z?y" — 3zy' + 13y 2 0. 11. z3y" — 2z?y" —2zxy' + 8y=0 12. xy” — 2zy/ — 4Ay — x 
2.8 PHASE DIAGRAMS 


In Section 1.6 we showed how solutions to first-order ordinary differential equations 
could be qualitatively solved through the use of the phase line. This concept of qualita- 
tively studying differential equations showed promise as a method for deducing many of 
the characteristics of the solution to a differential equation without actually solving it. In 
this section we extend these concepts to second-order ordinary differential equations by 
introducing the phase plane. 

Consider the differential equation 


x” + sgn(x) = 0, (2.8.1) 
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Figure 2.8.1: Phase diagram for the differential equation, Equation 2.8.1. 


where the signum function is defined by 


1, t > 0, 
sgn(t) = 0, t=0, 
—1, t<0. 


Equation 2.8.1 describes, for example, the motion of an infinitesimal ball rolling in a “V”- 
shaped trough in a constant gravitational field." 
Our analysis begins by introducing the new dependent variable v — z' so that Equation 
2.8.1 can be written F 
v— 4 sgn(z) = 0, (2.8.2) 
dx 


since 


ip OB dv  drdv dv 28.3 
^ — dB dt dide dw Be) 
Equation 2.8.2 relates v to x and t has disappeared explicitly from the problem. Integrating 
Equation 2.8.2 with respect to x, we obtain 


nz NE dx — C, or zv? + |z| = C. (2.8.4) 


Equation 2.8.4 expresses conservation of energy because the first term on the left side of 
this equation expresses the kinetic energy while the second term gives the potential energy. 
The value of C depends upon the initial condition z(0) and v(0). Thus, for a specific initial 
condition, our equation gives the relationship between x and v for the motion corresponding 
to the initial condition. 

Although there is a closed-form solution for Equation 2.8.1, let us imagine that there 
is none. What could we learn from Equation 2.8.4? 

Equation 2.8.4 can be represented in a diagram, called a phase plane, where x and v 
are its axes. A given pair of (z,v) is called a state of the system. A given state determines 
all subsequent states because it serves as initial conditions for any subsequent motion. 


7 See Lipscomb, T., and R. E. Mickens, 1994: Exact solution to the axisymmetric, constant force 
oscillator equation. J. Sound Vib., 169, 138-140. 
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For each different value of C, we will obtain a curve, commonly known as phase paths, 
trajectories, or integral curves, on the phase plane. In Figure 2.8.1, we used the MATLAB 
Script: 
clear 
^4 set up grid points in the (x,v) plane 
[x,v] = meshgrid(-5:0.5:5,-5:0.5:5); 
^4 compute slopes 
dxdt = v; dvdt = -sign(x); 
^4 find magnitude of vector [dxdt,dydt] 

L = sqrt (dxdt.*dxdt + dvdt.*dvdt); 

% plot scaled vectors 

quiver (x,v,dxdt./L,dvdt./L,0.5); axis equal tight 

hold 

% contour trajectories 

contour(x,v,v.*v/2 + abs(x) ,8) 

h = findobj(’Type’,’patch’); set(h, ’Linewidth’ ,2); 
xlabel(’x’,’Fontsize’,20); ylabel(’v’,’Fontsize’ ,20) 

to graph the phase plane for Equation 2.8.1. Here the phase paths are simply closed, oval- 
shaped curves that are symmetric with respect to both the x and v phase space axes. Each 
phase path corresponds to a particular possible motion of the system. Associated with each 
path is a direction, indicated by an arrow, showing how the state of the system changes as 
time increases. 

An interesting feature on Figure 2.8.1 is the point (0,0). What is happening there? In 
our discussion of the phase line, we sought to determine whether there were any equilibrium 
or critical points. Recall that at an equilibrium or critical point, the solution is constant 
and was given by xz’ = 0. In the case of second-order differential equations, we again have 
the condition x’ = v = 0. For this reason, equilibrium points are always situated on the 
abscissa of the phase diagram. 

The condition x’ = 0 is insufficient for determining critical points. For example, when 
a ball is thrown upward, its velocity equals zero at the peak height. However, this is clearly 
not a point of equilibrium. Consequently, we must impose the additional constraint that 
xz" = v' = 0. In the present example, equilibrium points occur where x’ = v = 0 and 
v' = —sgn(r) = 0 or x = 0. Therefore, the point (0,0) is the critical point for Equation 


The closed curves immediately surrounding the origin in Figure 2.8.1 show that we 
have periodic solutions there because on completing a circuit, the original state returns and 
the motion simply repeats itself indefinitely. 

Once we have found an equilibrium point, an obvious question is whether it is stable 
or not. To determine this, consider what happens if the initial state is displaced slightly 
from the origin. It lands on one of the nearby closed curves and the particle oscillates with 
small amplitude about the origin. Thus, this critical point is stable. 

In the following examples, we further illustrate the details that may be gleaned from a 
phase diagram. 


e Example 2.8.1 
The equation describing a simple pendulum is 


ma?6" + mgasin(0) = 0, (2.8.5) 
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Figure 2.8.2: Phase diagram for a simple pendulum. 


where m denotes the mass of the bob, a is the length of the rod or light string, and g is the 
acceleration due to gravity. Here the conservation of energy equation is 
Ima?’ — mga cos(0) = C. (2.8.6) 
Figure 2.8.2 is the phase diagram for the simple pendulum. Some of the critical points 
are located at 0 = +2nr, n = 0,1,2,..., and 0' = 0. Near these critical points, we have 
closed patterns surrounding these critical points, just as we did in the earlier case of an 
infinitesimal ball rolling in a “V”-shaped trough. Once again, these critical points are 
stable and the region around these equilibrium points corresponds to a pendulum swinging 
to and fro about the vertical. On the other hand, there is a new type of critical point at 
= +(2n—1)7,n = 0,1,2,... and 0' = 0. Here the trajectories form hyperbolas near these 
equilibrium points. Thus, for any initial state that is near these critical points, we have 
solutions that move away from the equilibrium point. This is an example of an unstable 
critical point. Physically these critical points correspond to a pendulum that is balanced 
on end. Any displacement from the equilibrium results in the bob falling from the inverted 
position. 
Finally, we have a wavy line as 6’ — -too. This corresponds to whirling motions of the 
pendulum where 6’ has the same sign and 0 continuously increases or decreases. 


e Example 2.8.2: Damped harmonic oscillator 
Consider the ordinary differential equation 
x” +22’ + 5x — 0. (2.8.7) 
The exact solution to this differential equation is 
x(t) = e™* [Acos(2t) + B sin(2t)], (2.8.8) 
and 
z'(t) = 2e~* [B cos(2t) — Asin(2t)|] — e~* [Acos(2t) + Bsin(2t)] . (2.8.9) 


To construct its phase diagram, we again define v = x’ and replace Equation 2.8.7 with 
v’ = —2v — 5a. The MATLAB script: 

clear 

^4 set up grid points in the x,x’ plane 

[x,v] = meshgrid(-3:0.5:3,-3:0.5:3); 

^4 compute slopes 
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Figure 2.8.3: Phase diagram for the damped harmonic oscillator, Equation 2.8.7. 


dxdt = v; dvdt = -2*v - 5x; 

^ find length of vector 

L = sqrt(dxdt.*dxdt + dvdt.*dvdt); 

^4 plot direction field 
quiver(x,v,dxdt./L,dvdt./L,0.5); axis equal tight 


hold 
^4 compute x(t) and v(t) at various times and a’s and b’s 
for b = -3:2:3; for a = -3:2:3; 
t = [-5:0.1:5]; 
xx = exp(-t) .* (a*cos(2*t) + b*sin(2*t)); 
vv = 2 * exp(-t) .* (b*cos(2*t) - a*sin(2*t)) - xx; 
^4 plot these values 
plot (xx, vv) 
end; end; 
xlabel(’x’,’Fontsize’,20); ylabel(’v’,’Fontsize’ ,20) 
was used to construct the phase diagram for Equation 2.8.7 and is shown in Figure 2.8.3. 
Here the equilibrium point is at x = v = 0. This is a new type of critical point. It is called 
a stable node because all slight displacements from this critical point eventually return to 
this equilibrium point. 


Problems 


1. Using MATLAB, construct the phase diagram for z^ — 3z' + 2x = 0. What happens 
around the point z — v — 0? 


2. Consider the nonlinear differential equation z” = z? — x. This equation arises in the 
study of simple pendulums with swings of moderate amplitude. 


(a) Show that the conservation law is 


What is special about C = 0 and C = 1? 
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(b) Show that there are three critical points: z = 0 and x = +1 with v = 0. 
(c) Using MATLAB, graph the phase diagram with axes x and v. 


For the following ordinary differential equations, find the equilibrium points and then clas- 
sify them. Use MATLAB to draw the phase diagrams. 


ae / 7 — " à | e 
3. a" — 2x 4. x" +sgn(x)x = 0 9. -is |x| < 2. 


2.9 NUMERICAL METHODS 


When differential equations cannot be integrated in closed form, numerical methods 
must be employed. In the finite difference method, the discrete variable z; or t; replaces the 
continuous variable x or t and the differential equation is solved progressively in increments 
h starting from known initial conditions. The solution is approximate, but with a sufficiently 
small increment, you can obtain a solution of acceptable accuracy. 

Although there are many different finite difference schemes available, we consider here 
only two methods that are chosen for their simplicity. The interested student may read any 
number of texts on numerical analysis if he or she wishes a wider view of other possible 
schemes. 

Let us focus on second-order differential equations; the solution of higher-order differen- 
tial equations follows by analog. In the case of second-order ordinary differential equations, 
the differential equation can be rewritten as 


a" =f(2,2',t), 29 =2(0), my =2'(0), (2.9.1) 


where the initial conditions zo and xp are assumed to be known. 
For the present moment, let us treat the second-order ordinary differential equation 


a = f(x,t), zo = x(0), xo = x (0). (2.9.2) 


The following scheme, known as the central difference method, computes the solution from 
Taylor expansions at £i+ı and cj: 


Tizi = zi + ha, + Zh?! 4 ivy + O(h*) (2.9.3) 


and 
Tjj = x — hai + h?g! — Zhe al’ + O(h*), (2.9.4) 


where h denotes the time interval At. Subtracting and ignoring higher-order terms, we 
obtain 


/ Tirpl — Vi-1 
= LL———, 2.9.5 
of = TEL (2.9.5) 
Adding Equation 2.9.3 and Equation 2.9.4 yields 
noo an Oe (2.9.6) 


D h2 


In both Equation 2.9.5 and Equation 2.9.6 we ignored terms of O(h?). After substituting 
into the differential equation, Equation 2.9.2, Equation 2.9.6 can be rearranged to 


Lig = 2; — zia th? f (viti), i>], (2.9.7) 
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which is known as the recurrence formula. 

Consider now the situation when i = 0. We note that although we have x9 we do 
not have z.;. Thus, to start the computation, we need another equation for xı. This is 
supplied by Equation 2.9.3, which gives 


z1 = To + hxg + h?r = zo + hay + LA? f (xo, to). (2.9.8) 


Once we have computed x1, then we can switch to Equation 2.9.6 for all subsequent calcu- 
lations. 

In this development we have ignored higher-order terms that introduce what is known 
as truncation errors. Other errors, such as round-off errors, are introduced due to loss 
of significant figures. These errors are all related to the time increment h in a rather 
complicated manner that is investigated in numerical analysis books. In general, better 
accuracy is obtained by choosing a smaller h, but the number of computations will then 
increase together with errors. 


e Example 2.9.1 


Let us solve x” — 4x = 2t subject to z(0) = z'(0) = 1. The exact solution is 


a(t) = ie" + ie ^ — it. (2.9.9) 
'The MATLAB script: 
clear 
^4 test out different time steps 
for i = 1:3 


^4 set up time step increment and number of time steps 
h = 1/10^i; n = 10/h; 
% set up initial conditions 
t-zeros(nti,1); t(1) = 0; x(1) = 1; xexact(1) = 1; 
^ define right side of differential equation 
f = inline(’?4*xx+2*tt’ ,"^ tt? ,? xx?) ; 
^4 set up difference arrays for plotting purposes 
diff = zeros(n,1); t plot = zeros(n,1); 
^4 compute first time step 
t(2) = t(1) + h; x(2) = x(1) + h + 0.5*h*h*f(t(1),x(1)); 
x exact(2) = (7/8)*exp(2*t (2))* (1/8) *exp(-2*t (2)) -t (2) /2; 
t plot(1) = t(2); 
diff (1)=x(2)-x_exact(2); diff(1)=abs (diff (1) /x_exact(2)); 
^4 compute the remaining time steps 
for k = 2:n 
t(k+1) = t(k) + h; t plot(k) = t(k*1); 
x(k+1) = 2*x(k) - x(k-1) + h*h*f(t(k),x(k)); 
x_exact(k+1) = (7/8) *exp(2*t (k+1))+(1/8) *exp(-2*t (k+1)) 
- t(k+1)/2; 
diff(k) = x(k*1) - x_exact(k+1); 
diff (k) = abs(diff(k) / x exact(k*1)); 
end 
% plot the relative error 
semilogy(t_plot,diff,’-’) 
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Figure 2.9.1: The numerical solution of x” — 4x = 2t when z(0) = z'(0) = 1 using a simple finite difference 
approach. 


hold on 
num = 0.2*n; 
text(3*i,diff(num),[?h = ?,num2str(h)],"Fontsize',15,... 
^"HorizontalAlignment? ,?right? ,'VerticalAlignment' ," bottom?) 
xlabel( TIME! ,?Fontsize?,20); 
ylabel(C |RELATIVE ERROR|?,?Fontsize?,20); 
end 


implements our simple finite difference method of solving a second-order ordinary differential 


equation. In Figure 2.9.1 we have plotted results for three different values of the time step. 
As our analysis suggests, the relative error is related to h?. 


An alternative method for integrating higher-order ordinary differential equations is 
Runge-Kutta. It is popular because it is self-starting and the results are very accurate. 

For second-order ordinary differential equations, this method first reduces the differen- 
tial equation into two first-order equations. For example, the differential equation 


t) — kx — ca’ 
gl = f( ) vc CL = F(a, x, t) 
m 


(2.9.10) 


becomes the first-order differential equations 
a—y, — y =F(a,y,t). (2.9.11) 


'The Runge-Kutta procedure can then be applied to each of these equations. Using a fourth- 
order scheme, the procedure is as follows: 


and 
Yar = yi + h(Kı + 2K5 + 2K3 + K1), (2.9.13) 
where 
ky = Vis ky = F (xi, yi, ti), (2.9.14) 
ko = yi T 2K, Ko = F(x; zr Pk ko, ti ERES 2), (2.9.15) 
k3 = yi T 2 Ko, K3 = F(x; sh P ko, k3, ty US 2), (2.9.16) 
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Figure 2.9.2: The numerical solution of z” — 4x = 2t when z(0) = z'(0) = 1 using the Runge-Kutta 
method. 


and 


k4 = yi + Ksh, Kı = F(a; + hkz, k4, ti + h). (2.9.17) 


e Example 2.9.2 


The MATLAB script: 


clear 

% test out different time steps 

for i= 1:4 

^4 set up time step increment and number of time steps 
if i==1 h = 0.50; end; if i==2 h = 0.10; end; 
if i--3 h = 0.05; end; if i--4 h = 0.01; end; 


nn = 10/h; 
% set up initial conditions 
t-zeros(nti,1); t(1) = 0; 
xrk-zeros(nti,1); xrk(1) = 1; 
y_rk=zeros(n+1,1); y rk(1) = 1; 
x exact-zeros(n*i,1); x exact(1) = 1; 
^ set up difference arrays for plotting purposes 
t_plot = zeros(n,1); diff = zeros(n,1); 
^ define right side of differential equation 
f = inline(?4*xx*2*tt? ,? tt? ^ xx? ,?yy?); 


for k = 1:n 
t_local = t(k); x local = x rk(k); y_local = y_rk(k); 
k1 = y_local; K1 = f(t_local,x_local,y-_local) ; 
k2 = y_local + h*K1/2; 
K2 = £(t_local + h/2,x local + h*ki/2,k2); 
k3 = y_local + h*K2/2; 
K3 = f(t local + h/2,x local + h*k2/2,k3); 
k4 = y_local + h*K3; K4 = f(t_local + h,x_local + h*k3,k4); 


t(k+1) = t loc 
x_rk(k+1) = x local + (h/6) * (k1+2*k2+2*k3+k4) ; 
y-rk(k*1) = y_local + (h/6) * (K1+2*K2+2*K3+KA) ; 


x_exact(k+1) = (7/8) *exp(2*t (k+1))+(1/8) *exp(-2*t (k+1)) 


al + h; 


- t(k*1)/2; 
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0.6 


-0.2 -0.1 0 0.1 0.2 


Figure 2.9.3: The phase diagram of the dynamical system given by Equations 2.9.18 and 2.9.19 by 
modified Euler method. Here the parameters are g — 9.8 m/sec?, L — 1 m, b — 0.22/sec, k — 0.02/sec, and 
At = 0.005. The initial conditions are 0(0) = 7/18 and 6'(0) = 0. 


t_plot(k) = t(k); 
diff(k) = xrk(k*i) - x exact(k*1); 
diff (k) = abs(diff(k) / x.exact(k*1)); 
end 
^4 plot the relative errors 
semilogy(t_plot,diff,’-’) 
hold on 
xlabel( TIME! ,’Fontsize’ ,20); 
ylabel(’ |RELATIVE ERROR|’,’Fontsize’ ,20); 
text (2*i1,diff(0.2*n),[’h = ’,num2str(h)],’Fontsize’,15,... 
?HorizontalAlignment’,’right’,’VerticalAlignment’ ,’ bottom’) 
end 


was used to resolve Example 2.9.1 using the Runge-Kutta approach. Figure 2.9.2 illustrates 
the results for time steps of various sizes. 


Problems 
In previous sections, you found exact solutions to second-order ordinary differential equa- 


tions. Confirm these earlier results by using MATLAB and the Runge-Kutta scheme to find 
the numerical solution to the following problems drawn from previous sections. 


1. Section 2.1, Problem 1 2. Section 2.1, Problem 5 
3. Section 2.4, Problem 1 4. Section 2.4, Problem 5 
5. Section 2.6, Problem 1 6. Section 2.6, Problem 5 


Project: Pendulum Clock 


In his exposition on pendulum clocks, M. Denny? modeled the system by the second- 
order differential equation in time t: 


0" + b0' + w0 = kf (0,0), (2.9.18) 


8 Denny, M., 2002: The pendulum clock: A venerable dynamical system. Eur. J. Phys., 23, 449-458. 
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Van der Pol, x(0) = 10.00, v(0) = 3.00, c = 2.00 


x(t) or v(t) 


t 


Phase portrait, x(0) = 10.00, v(0) = 3.00, c = 2.00 


Figure 2.9.4: x(t) and v(t) for van der Pol’s oscillator with A = 0 when numerically integrated using the 
Runge-Kutta scheme with a time step of At = 0.001. 


where 
1/(At), 0| < At/2, 0' >0; 


n 
fee y { 0, otherwise; ae) 


and w? = g/L — b?/4. Here At denotes some arbitrarily small nondimensional time. In 
Chapter 7 we identify this forcing as the Dirac delta function. 

Using the numerical scheme of your choice, develop a MATLAB code to numerically 
integrate this differential equation. Plot the results as a phase diagram with 0 as the 
abscissa and 6’ as the ordinate. What happens with time? What happens as k varies? 
Figure 2.9.3 illustrates the solution. 


Project: Van der Pol Oscillator 


In the 1920s and 1930s, Balthazar van der Pol (1889-1959), a Dutch physicist and 
electrical engineer, studied simple electrical circuits that included vacuum tubes during 
his employment at Phillips Lab. He modeled the response of the system to the forcing of 
A sin(wt) by the second-order, nonlinear, ordinary differential equation: 


d?x(t) 
dt? 


de(t) 


et - a? (07 


+ z(t) = Asin(wt), c> 0, 


commonly referred to as van der Pol’s equation. Because of its nonlinearity, the general 
solution must be found numerically. Generally the second-order differential equation is 
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Forced van der Pol, x(0) = 10.00, v(0) = 3.00, c = 0.10, A = 10.00, omega = 0.20 


x(t) or v(t) 


Phase portrait 


x(0) = 10.00, v(0) = 3.00, c = 0.10, A = 10.00, omega = 0.20 


b 


Figure 2.9.5: Same as Figure 2.9.4 except that now A = 10 and w = 0.2. 


replaced by two first-order differential equations: 
dx(t) dv(t) 
a D dt 
before a particular numerical scheme is employed. The purpose of this project is to analyze 
van der Pol's equation via numerical integration. 


= c[1 — z?(t)]v(t) — x(t) + Asin(wt), 


Step 1: Show that our system of first-order equations is equivalent to Van der Pol's equation. 


Step 2: Using MATLAB’s routine ode45, write code which solves van der Pol’s equation for 
given x(0), v(0), c, A, w and time step At. 


Step 3: Conduct numerical experiments when A = 0 for various values of c > 0 and discuss 
differences in the solution as the parameter c varies. In particular, plot z(t) and v(t) as a 
function of t and plot the corresponding phase diagram. 


Step 4: Now choose an A and w and repeat Step 3. 
Further Readings 


Boyce, W. E., and R. C. DiPrima, 2004: Elementary Differential Equations and Boundary 
Value Problems. Wiley, 800 pp. Classic textbook. 


Ince, E. L., 1956: Ordinary Differential Equations. Dover, 558 pp. The source book on 
ordinary differential equations. 


Zill, D. G., and M. R. Cullen, 2008: Differential Equations with Boundary- Value Problems. 
Brooks Cole, 640 pp. Nice undergraduate textbook. 


Taylor & Francis 
Taylor & Francis Group 


http://taylorandfrancis.com 
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Chapter 3 
Linear Algebra 


Linear algebra was developed for the systematic solving of linear algebraic or differential 
equations where we have several unknowns. These equations are written and solved using 
the concepts of matrices and vectors. In this chapter we explore these concepts and their 
use in solving linear equations. 


3.1 FUNDAMENTALS 


Consider the following system of m simultaneous linear equations in n unknowns 
31;12,073,... Xn: 


Q1111 T 012172 T ^7 T Q1n 3m = bi, 


02111 T 42212 c T A2nIn = bo, 


(3.1.1) 
Am1L1 + Am2%2 + +++ + Amntn = bm, 


where the coefficients a;; and constants b; denote known real or complex numbers. The 
purpose of this chapter is to show how matrix algebra can be used to solve these systems by 
first introducing succinct notation so that we can replace Equation 3.1.1 with rather simple 
expressions, and then by employing a set of rules to manipulate these expressions. In this 
section we focus on developing these simple expressions. 

One of the fundamental quantities in linear algebra is the matriz. A matrix is an 
ordered rectangular array of numbers or mathematical expressions. We shall use uppercase 


1 


l This term was first used by J. J. Sylvester, 1850: Additions to the articles, “On a new class of 
theorems,” and “On Pascal’s theorem." Philos. Mag., Ser. 4, 37, 363-310. 
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letters to denote them. The m x n matrix 


11 12 013 n eee eae Ain 
21 22 23 Dn see eee An 
A= ] : : : : : (3.1.2) 
. . . . Qij . . 
Ami Am2 Am3 : : : Amn 


has m rows and n columns. The order (or size) of a matrix is determined by the number 
of rows and columns; Equation 3.1.2 is of order m by n. If m = n, the matrix is a square 
matrix; otherwise, A is rectangular. The numbers or expressions in the array ajj are the 
elements of A and can be either real or complex. When all of the elements are real, A is 
a real matrix. If some or all of the elements are complex, then A is a complex matrix. For 
a square matrix, the diagonal from the top left corner to the bottom right corner is the 
principal diagonal. The trace (often abbreviated to tr) of a square matrix is defined to be 
the sum of elements on the main diagonal (from the upper left to the lower right). 

From the limitless number of possible matrices, certain ones appear with sufficient 
regularity that they are given special names. A zero matrix (sometimes called a null matrix) 
has all of its elements equal to zero. It fulfills the role in matrix algebra that is analogous 
to that of zero in scalar algebra. The unit or identity matrix is an n x n matrix having 1’s 
along its principal diagonal and zero everywhere else. The unit matrix serves essentially 
the same purpose in matrix algebra as does the number one in scalar algebra. A symmetric 
matrix is one where aij = aji for all i and j. 

Two matrices A and B are equal if and only if aj; = bi; for all possible i and j and 
they have the same dimensions. 


e Example 3.1.1 
Examples of zero, identity, and symmetric matrices are 


00 0 bun 3-9 4 
O=|0 0 0], = » and A=[2 1 0], (3.1.3) 
00 0 405 


respectively. 


Having defined a matrix, let us explore some of its arithmetic properties. For two 
matrices A and B with the same dimensions (conformable for addition), the matrix C = 
A + B contains the elements cj; = aij + bij. Similarly, C = A — B contains the elements 
Cij = Qij — bij. Because the order of addition does not matter, addition is commutative: 
A+B=B+A. 

Consider now a scalar constant k. The product kA is formed by multiplying every 
element of A by k. Thus the matrix kA has elements kaij. 

So far, the rules for matrix arithmetic conform to their scalar counterparts. However, 
there are several possible ways of multiplying two matrices together. For example, we might 
simply multiply together the corresponding elements from each matrix. This is not correct 
and we now derive the right rule. 

We begin by requiring that the dimensions of A be m x n while for B they are n x p. 
That is, the number of columns in A must equal the number of rows in B. The matrices A 
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and B are then said to be conformable for multiplication. If this is true, then C = AB is a 
matrix m x p, where its elements equal 


n 
Cjj = X air bkj. (3.1.4) 
k=l 


The right side of Equation 3.1.4 is referred to as an inner product of the ith row of A and the 
jth column of B. Although Equation 3.1.4 is the method used with a computer, an easier 
method for human computation is as a running sum of the products given by successive 
elements of the ith row of A and the corresponding elements of the jth column of B. 

The product AA is usually written A?; the product AAA, A?, and so forth. 


e Example 3.1.2 


If 
4-(3 EJ and B=(5 25 (3.1.5) 
then 
 (K-00-403) C090]. (1n n 
ages o ete =) P0) 


Checking our results using MATLAB, we have that: 
>> A= [-1 4; 2 -3]; 

>> B= [1 2; 3 4]; 

>> C = A*B 


C= 
11 14 


-7 -8 


Note that there is a tremendous difference between the MATLAB command for matrix 
multiplication * and element-by-element multiplication .x*. 


Matrix multiplication is associative and distributive with respect to addition: 


(kA)B = k(AB) = A(KkB), (3.1.7) 
A(BC) = (AB)C, (3.1.8) 
(A+ B)C = AC + BC, (3.1.9) 
and 
C(A-- B) 2 CA«* CB. (3.1.10) 


On the other hand, matrix multiplication is not commutative. In general, AB 4 BA. 
e Example 3.1.3 


Does AB — BA if 


1 0 Td 
= = ? 
A € i) , and B t 3: (3.1.11) 
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a(i ))( 2) 9) sas 
»-( DG $)=(1 8): sias 


AB + BA. (3.1.14) 


Because 


and 


e Example 3.1.4 
Given 


1 1 -1 1 
xe sopa 4), Bais 
find the product AB. 


Performing the calculation, we find that 


aB=(5 5) & DE 3 (3.1.16) 


The point here is that just because AB = 0, this does not imply that either A or B equals 
the zero matrix. 


We cannot properly speak of division when we are dealing with matrices. Nevertheless, 
a matrix A is said to be nonsingular or invertible if there exists a matrix B such that 
AB = BA = I. This matrix B is the multiplicative inverse of A or simply the inverse of A, 
written A~'. An n x n matrix is singular if it does not have a multiplicative inverse. 


e Example 3.1.5 


If 
1 0 1 
A=|3 3 4], (3.1.17) 
2 2 3 
let us verify that its inverse is 
Le 2.3 
At=[-1 1 -1)]. (3.1.18) 
0 -2 3 


We perform the check by finding AA~! or ATHA, 


10 1 1 2 -3 1 
AA 1—-|[3 3 4 —1 1 -1])=1{0 
2 2 3 0 


0 0 
1 0]. (3.1.19) 
0 -2 3 0 1 


In a later section we will show how to compute the inverse, given A. 
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Another matrix operation is transposition. The transpose of a matrix A with dimen- 
sions m x n is another matrix, written AT, where we interchange the rows and columns 
from A. In MATLAB, AT is computed by typing A’. Clearly, (AT)? = A as well as 
(A+ B)T = AT + BT, and (kA)? = kAT. If A is symmetric, then AT = A. Finally, 
if A and B are conformable for multiplication, then (AB)? = BT AT. Note the reversal of 
order between the two sides. To prove this last result, we first show that the results are 
true for two 3 x 3 matrices A and B and then generalize to larger matrices. 

Having explored matrix operations, we now introduce two more fundamental quantities: 
column vectors and row vectors: 


T1 


x=| . |> y=(y w ++ gn). (3.1.20) 
Tm 


We denote row and column vectors by lowercase, boldfaced letters. They are a special class 
of matrices, namely an m matrix and a 1 x n matrix, respectively. Consequently, they 
are not the same thing, as MATLAB continuously reminds you. The length or norm of the 


vector x of n elements is 
" 1/2 
|[x]] = (>: 2 (3.1.21) 
k=1 


e Example 3.1.6: Vector space R” 


Why have we called these special matrices vectors? The answer lies in the strong analog 
between these n-dimensional vectors and the three-dimensional vectors from physics. Both 
column and row vectors are examples of n-vectors and consist of n components. If the 
components are real, then the totality of all n-vectors is denoted by R” and called an R” 
vector space. An example of an R? vector space consists of all two-dimensional vectors with 
the components (x1 x3). Vector spaces enjoy the property that the sum (addition) of two 
vectors in R” yields another vector in R”. Another property is that a vector in R” can be 
multiplied by a real number (scalar) that merely scales the vector. 


Having introduced some of the basic concepts of linear algebra, we are ready to rewrite 
Equation 3.1.1 in a canonical form so that we can present techniques for its solution. We 
begin by writing Equation 3.1.1 as a single column vector: 


àj131 + 1242 k Q1nXn by 
GQ21%1 + 2222. Ft Amn b2 
; i ex |! ase (3.1.22) 
QmiXi +  Qm232 + +++ + Amnn bm 
We now use the multiplication rule to rewrite Equation 3.1.22 as 
Q11 Q12 ^"^* Qin Tı bı 
a21 Q22 Q2n T2 b» 
; =| |; (3.1.23) 


Ami Am2 Ut Amn Tn bm 
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Or 
Ax — b, (3.1.24) 


where x is the solution vector. If b — 0, we have a homogeneous set of equations; otherwise, 
we have a nonhomogeneous set. In the next few sections, we will give a number of methods 
for finding x. 


e Example 3.1.7: Solution of a tridiagonal system 


A common problem in linear algebra involves solving systems such as 


biy + crys = di, (3.1.25) 

azyi + 0292 + c2y3 = d», (3.1.26) 

aN-1UN-2 + bN-1UN-1 + CN-iUN = dNn-1, (3.1.27) 
bvyn-1 + CNUN = dy. (3.1.28) 


Such systems arise in the numerical solution of ordinary and partial differential equations. 
We begin by rewriting Equation 3.1.25 through Equation 3.1.28 in the matrix notation: 


bi C1 0 t 0 0 0 yı dı 
a» b» Da vw 0 0 0 ya d» 

0 Q3 b3 DEC 0 0 0 Y3 d3 

NE : ; i = neg m (3.1.29) 
0 0 0 >- oux Dear ENG UN-1 dx-1 

0 0 0 Set 0 an bn UN dn 


The matrix in Equation 3.1.29 is an example of a banded matrix: a matrix where all of 
the elements in each row are zero except for the diagonal element and a limited number 
on either side of it. In the present case, we have a tridiagonal matrix in which only the 
diagonal element and the elements immediately to its left and right in each row are nonzero. 
Consider the nth equation. We can eliminate a, by multiplying the (n — 1)th equation 
by a4 /b,..; and subtracting this new equation from the nth equation. The values of bj, and 
dn become 
b, = bn A anCn—1/bn-1, and dl, = dn E Gs dg 1/051 (3.1.30) 
for n = 2,3,...,N. The coefficient cn is unaffected. Because elements a, and cy are never 
involved, their values can be anything or they can be left undefined. The new system of 
equations may be written 


Ug 0.0 0 0 yı di, 
0 bb c» 0 0 0 ya d 
OO) dés sue. 0 0 m dh 
A A ; : . f = ; . (3.1.31) 
0 0 0 $558 0 AE CN—1 YN-1 dy i 
Ü. d xw 6h 0 bly YN N 


The matrix in Equation 3.1.31 is in upper triangular form because all of the elements 
below the principal diagonal are zero. This is particularly useful because y,, can be computed 
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by back substitution. That is, we first compute yy. Next, we calculate yy_ in terms of 
yw. The solution yy_2 can then be computed in terms of yy and yw..1. We continue this 
process until we find y; in terms of yv, yu 1, ..., Y2. In the present case, we have the rather 
simple: 

yn =dy/by, and — gs = (d, — cud, ,1)/b (3.1.32) 


fon-N-1,N-2,..,2,1. 

As we shall show shortly, this is an example of solving a system of linear equations 
by Gaussian elimination. For a tridiagonal case, we have the advantage that the solution 
can be expressed in terms of a recurrence relationship, a very convenient feature from 
a computational point of view. This algorithm is very robust, being stable? as long as 
la; + c;| < |b;|. By stability, we mean that if we change b by Ab so that x changes by Ax, 
then ||Ax|| < Me, where ||Ab|| € e, 0 < M < oo, for any N. Here ||- || denotes the norm 
which is defined by Equation 3.1.21. 


e Example 3.1.8: Linear transformation 


Consider a set of linear equations 


Yı = 01121 + 01222 + 01323 + 01424, 


Y2 = 02141 + 02212 + 02313 + 02424, (3.1.33) 


Y3 = 0312, + A31X2 + 03333 + 03424. 


Each of the right-side expressions is called a linear combination of x1, x2, x3, and x4: a sum 
where each term consists of a constant times x; raised to the first power. An expression 
such as ar? ! air? H 01312 | aiat is an example of a nonlinear combination. Note that 
we are using 4 values of x; to find only 3 values of y;. 

If we were given values of z;, we could determine a set of values for y; using Equation 
3.1.33. Such a set of linear equations that yields values of y; for given z;'s is called a linear 
transform of x into y. The point here is that given x, the corresponding y will be evaluated. 

Matrix notation and multiplication are very convenient in expressing linear transfor- 
mations. We begin by writing Equation 3.1.33 in matrix format: 


Tı 
yi Q1111 T 01272 T 01313 T Q14T4 Q11 412 Q13 G14 £o 
y2 = | a214X1 T 02212 T 23:3 T Q24%4 = | 421 Q22 Q23 Q24 r3 |^ 
Y3 431%] T 431%2 T 033173 T 03414 431 Q32 433 434 4 
(3.1.34) 


where we have used the matrix multiplication rule Equation 3.1.4 to replace the middle 
term with the right term in Equation 3.1.34. Finally, by introducing the (column) vectors 
x and y and the matrix A: 


Tı 


T2 yi Q11 412 Q13 Q14 
x= T3 ; y= Y2 . and A= Q21 Q22 Q23 Q24 ; (3.1.35) 
Y3 431 Q32 433 Q34 
T4 


2 Torii, T., 1966: Inversion of tridiagonal matrices and the stability of tridiagonal systems of linear 
systems. Tech. Rep. Osaka Univ., 16, 403-414. 
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we have the compact expression y = Ax for the linear transformation expressed by Equation 
3.1.33. 

Let us now introduce the notation T(x) = Ax. Then, for any vectors u and v in 
the vector space R”, we have a linear transformation if we satisfy two conditions: (1) 
T(u +v) 2 T(u) - T(v) and (2) T(ku) = kT(u), where k is a scalar. 


Problems 
Given A= (1 rand B= (5 >) fra 
1.A+B,B+A 2 A-B,B-A 3. 3A — 2B, 3(2A — B) 
4. AT ,BT CETT 5. (A+ B)T, AT + BT 6. B+ BT, B- BT 
7. AB,AT B,BA,BTA 8. A*, B? 9. BBT, BTB 
10. A? — 34 +I 11. 43 + 2A 12. At — 4A? + 2] 


by hand and using MATLAB. 


Can multiplication occur between the following matrices? If so, compute it. 


ES ; À 4 1 14. | -4 6](1 2 3) 
1 3 —6 1 
14 2 3 2 
15.|[0 0 4 11 16. G 2) (i : 3 
0 1 2 Qe dl 
6 4 2 3 1 4 —2 4 1 -3 7 2 
gs 2 J [ 0 y is. (5 J E 6 1 Jj 
1 1 
If A= | 1 2], verify that 
3 1 
19. 7A = 4A + 3A, 20. 10A = 5(2A), ot. (Aly =A 


by hand and using MATLAB. 


2 1 1 —2 1 1 : 
itA- (3 1) B=(4 SECCEIE L J verts that 


22. (A4-B) -C 2 A - (B 4 C), 23. (AB)C = A(BC), 


24. A(B + C) = AB + AC, 25. (A + B)C = AC + BC 
by hand and using MATLAB. 


Verify that the following A^! are indeed the inverse of A: 
3 1 2 1 0 1 0 0 1 0 
3. A-(* x) rhe 5) 27.A=]1 0 0 Acte. 
0 0 1 0 0 1 
by hand and using MATLAB. 
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Write the following linear systems of equations in matrix form: Ax — b. 


28.21 — 222 = 5 321 + 13 = 1 

29. 221 + £2 + 423 £5 4r, + 2x9 ar 5x3 =6 6x21 — 3x2 + 5za Ez 

30. £2 + 2x73 + 324 = 2 321 — 4x3 — 424 = 5 £1 + £2 + T3 + £4 = -—3 
2x1 — 3x2 + 23 — 324 = 7 


31. Given a square matrix A that satisfies the equation Ax = 0 and x 4 0. Show that A 
does not possess an inverse and is thus singular. 


32. If R is a rectangular matrix, prove that RT R is a symmetric matrix. 
3.2 DETERMINANTS 


Determinants appear naturally during the solution of simultaneous equations. Con- 
sider, for example, two simultaneous equations with two unknowns 2, and x», 


d1171 + d1222 = bi, (3.2.1) 


and 


d217; + 42222 = b2. (3.2.2) 
The solution to these equations for the value of zı and x» is 


b1a25 — a12b2 
qq = ———— —————, (3.2.3) 
011022 — 012021 


and 3 i 
2011 — 02101 
t = —————————, (3.2.4) 
011022 — 0120821 


Note that the denominator of Equation 3.2.3 and Equation 3.2.4 is the same. This term, 
which always appears in the solution of 2 x 2 systems, is formally given the name of deter- 


minant and written 
Q11 412 


det(A) — 


Wh ds = 011022 — 012002]. (3.2.5) 
MATLAB provides a simple command det(A), which computes the determinant of A. 
For example, in the present case, 
>> A= [2 -1 2; 132; 5 16]; 
>> det (A) 
ans = 
0 


Although determinants have their origin in the solution of systems of equations, any 
square array of numbers or expressions possesses a unique determinant, independent of 
whether it is involved in a system of equations or not. This determinant is evaluated (or 
expanded) according to a formal rule known as Laplace’s expansion of cofactors? The 


3 Laplace, P. S., 1772: Recherches sur le calcul intégral et sur le systéme du monde. Hist. Acad. R. 
Sci., II* Partie, 267-376. Œuvres, 8, pp. 369-501. See Muir, T., 1960: The Theory of Determinants in 
the Historical Order of Development, Vol. I, Part 1, General Determinants Up to 1841. Dover Publishers, 
pp. 24-33. 
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process revolves around expanding the determinant using any arbitrary column or row of 
A. If the ith row or jth column is chosen, the determinant is given by 


det(A) = ai Ail + ai2 Aja +++ Qin Ain = a1; Aj + 02; Aa; Tex Onj Anji; (3.2.6) 
where A;;, the cofactor of aij, equals (—1)'*? M;;. The minor Mj; is the determinant of the 
(n — 1) x (n — 1) submatrix obtained by deleting row i, column j of A. This rule, of course, 
was chosen so that determinants are still useful in solving systems of equations. 


e Example 3.2.1 


Let us evaluate 


2 —1 2 
1 3 2 
5 1 6 
by an expansion in cofactors. 
Using the first column, 
2 -1 2 
i 3 201)? qu + 1(-1)? ae tg +5(—1)* PE. (3.2.7) 
1 6 1 6 3 2 
5 1 6 
= 2(16) — 1(—8) + 5(—8) = 0. (3.2.8) 


The greatest source of error is forgetting to take the factor (—1)/*7 into account during the 
expansion. 


Although Laplace's expansion does provide a method for calculating det(A), the num- 
ber of calculations equals n!. Consequently, for hand calculations, an obvious strategy is to 
select the column or row that has the greatest number of zeros. An even better strategy 
would be to manipulate a determinant with the goal of introducing zeros into a particular 
column or row. In the remaining portion of this section, we show some operations that may 
be performed on a determinant to introduce the desired zeros. Most of the properties follow 
from the expansion of determinants by cofactors. 


e Rule 1 |: For every square matrix A, det( AT) = det(A). 


'The proof is left as an exercise. 


e | Rule 2 |: If any two rows or columns of A are identical, det(A) = 0. 


'To see that this is true, consider the following 3 x 3 matrix: 


by b a 
b» b» C2 | = C1 (b2b3 LI b3b2) = ca (b1b3 c 0301) + c3 (bbe = bob) =0. (3.2.9) 
b3 b3 c3 


e | Rule 3 |: The determinant of a triangular matrix is equal to the product of its diagonal 
elements. 
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If A is lower triangular, successive expansions by elements in the first column give 


ai 0 0 og! Se n 
d231 a22 >> O 
det (A) — . . 2; ; = 41 : E : = +++ = Q11022 ` ` ` ünn- (3.2.10) 
E E i x a. eee a. 
Qni  Qn2 Ut nn na ER 


If A is upper triangular, successive expansions by elements of the first row prove the prop- 
erty. 


e| Rule 4 |: If a square matrix A has either a row or a column of all zeros, then det(A) = 0. 


'The proof is left as an exercise. 


e| Rule 5 |: If each element in one row (column) of a determinant is multiplied by a number 
c, the value of the determinant is multiplied by c. 


Suppose that |B| has been obtained from |A| by multiplying row i (column j) of | A] by 
c. Upon expanding |B| in terms of row i (column j), each term in the expansion contains 
c as a factor. Factor out the common c, and the result is just c times the expansion |A| by 
the same row (column). 


e | Rule 6 |: If each element of a row (or a column) of a determinant can be expressed as a 
binomial, the determinant can be written as the sum of two determinants. 


'To understand this property, consider the following 3 x 3 determinant: 


Q1 T di bi C1 a1 bi C1 di bi C1 
à» T d» bə C2 | = | Q2 bə C2 | + d» bə C2 |. (3.2.11) 
3 T d3 b3 C3 3 bs C3 d3 b3 C3 


The proof follows by expanding the determinant by the row (or column) that contains the 
binomials. 


e Rule 7 |: If B is a matrix obtained by interchanging any two rows (columns) of a square 
matrix A, then det(B) = — det(A). 


The proof is by induction. It is easily shown for any 2 x 2 matrix. Assume that this 
rule holds for any (n — 1) x (n — 1) matrix. If A is n x n, then let B be a matrix formed by 
interchanging rows i and j. Expanding |B| and |A| by a different row, say k, we have that 


TL TL 


|B| = 3 (7-0) P6. Mrs, and |A| = 9 (-1)* "arks Nis, (3.2.12) 


s=] s=l 


where Mps and N;, are the minors formed by deleting row k, column s from |B| and |A], 


respectively. For s = 1,2,...,n, we obtain Ni, and My, by interchanging rows i and 7. By 
the induction hypothesis and recalling that Nj; and My, are (n— 1) x (n— 1) determinants, 
Ny, = —Mks for s = 1,2,...,n. Hence, |B| = —| A|. Similar arguments hold if two columns 


are interchanged. 
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e | Rule 8 |: If one row (column) of a square matrix A equals a number c times some other 
row (column), then det(A) = 0. 


Suppose one row of a square matrix A is equal to c times some other row. If c = 0, 
then |A| = 0. If c 4 0, then |A| = c| B|, where |B| = 0 because |B| has two identical rows. 
A similar argument holds for two columns. 


e | Rule 9 |: The value of det(A) is unchanged if any arbitrary multiple of any line (row or 
column) is added to any other line. 


To see that this is true, consider the simple example: 


Q1 bi Cl cbi bi C1 ay T cbi bi C1 
ag bo C2 | + cbo bo Cg) = |Gà2 Fr cb bg C2 |, (3.2.13) 
3 b3 C3 cbs bs C3 a3 T cbs bs C3 


where c Z 0. The first determinant on the left side is our original determinant. In the 
second determinant, we again expand the first column and find that 


chy b à bi b 6 
cb» bg C2 | = C b» b» C2 | = 0. (3.2.14) 
cbs b3 C3 b3 b3 C3 
e Example 3.2.2 
Let us evaluate 
1 2 3 4 
—1 1 2 3 
1 -1 1 2 
—-1 1 -1 5 


using a combination of the properties stated above and expansion by cofactors. 
By adding or subtracting the first row to the other rows, we have that 


1 2 


3 4 1 
3 5 T 
—] 1 2 3 0 3 5 T 
V ae ae OIE o: adr ddr asl = = = (3.2.15) 
-1 1 -1 5 0 3 2 9 
3 5 7 
AE M. x Je 3) =63 (3.2.16) 
0 —3 2 
Problems 


Evaluate the following determinants. Check your answer using MATLAB. 


3 12 4 3 0 
n EN did PU 3.|2 4 5 43 2 2 
14 5 5 -2 -4 
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9.14 1 1 6.]1 3 3 7 8. 
213 5 1 6 16 1 0 L.X Sh 
LoL 2 3 -3 2 3 1 


3| = (b—a)(c — a)(d — a)(c — b)(d — b)(d — c). 


This determinant is called Vandermonde’s determinant. 


10. Show that 


a b+c 1 
b a+c 1/=0 
c a+b 1 


11. Show that if all of the elements of a row or column are zero, then det(A) = 0. 
12. Prove that det(AT) — det(A). 
3.3 CRAMER'S RULE 


One of the most popular methods for solving simple systems of linear equations is 
Cramer’s rule.* It is very useful for 2 x 2 systems, acceptable for 3 x 3 systems, and of 
doubtful use for 4 x 4 or larger systems. 

Let us have n equations with n unknowns, Ax = b. Cramer's rule states that 


_ det(A1) _ det(A3) _ det(An) 
on = aa(A (3.3.1) 


= 


de(A)' "7^7 det(A)? "^" 


where A; is a matrix obtained from A by replacing the ith column with b and n is the 
number of unknowns and equations. Obviously, det(A) Z 0 if Cramer’s rule is to work. 
To prove? Cramer's rule, consider 


Q1121 012 Q13 `? Qin 
429111 Q22 Q23 *** Gan 

x, det(A) = | 43171 Q32 Q33 `’ 3n (3.3.2) 
Ani Ti  Qn2 An3 UC Ann 


^ Cramer, G., 1750: Introduction à l'analyse des lignes courbes algébriques. Geneva, p. 657. 


5 First proved by Cauchy, L. A., 1815: Mémoire sur les fonctions quine peuvent obtemir que deux valeurs 
égales et de signes contraires par suite des transportations opérées entre les variables qüelles renferment. J. 
l'Ecole Polytech., 10, 29-112. 
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by Rule 5 from the previous section. By adding x2 times the second column to the first 
column, 


G1111 T Qd1272 Q12 Q13 `` Gln 
211] T 42212 Q22 Q23 *** Aan 

zı det(A) = | 03171 T 03212 Q32 Q33 `’  03n | (3.3.3) 
Anii T Qn212  Qn2  Qn3 UC Ann 


Multiplying each of the columns by the corresponding x; and adding it to the first column 
yields 


Q111 T 01272 Tet Trainin 012 Q13 ^^^ Gin 
21011 T A222 cT G2n%n Q22 Q23 ^^ Gan 

x det(A) = | 03171 T 03272 TT A3n%n Q32 Q33 `` Q3n|, (3.3.4) 
Aniti T Qn2:2 22 Annn  Qn2  Qn3 ``’ Ann 


The first column of Equation 3.3.4 equals Ax and we replace it with b. Thus, 


by aig 413 > Ain 

b2 a22 a23 ^: Gan 
zı det(A) =|bs 32 433 t asn |= det(A), (3.3.5) 

bn n2 Q3 iens ann 

or d (A 
et 1 

= 3.3.6 
^17 “det (A) LS 


provided det(A) 4 0. To complete the proof we do exactly the same procedure to the jth 
column. 


e Example 3.3.1 


Let us solve the following system of equations by Cramer's rule: 


2x1 + £2 + 2x3 = —1, (3.3.7) 
X1 + 3 = —1, (3.3.8) 

and 
—21 + 329 — 2x3 = 7. (3.3.9) 


From the matrix form of the equations, 


2 1 2 41 —1 
EE i3 | 2|], (3.3.10) 
-1 3 -2 T3 T 
we have that 
2 d 2 
det(A)=| 1 0 1|-1 (3.3.11) 
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-1 1 2 
det(Ai) 2|-1. 0 1|-22 (3.3.12) 
7 3 -2 
2 -1 2 
det(42)=| 1 -1 1|=1, (3.3.13) 
-1 7 -2 
and 
2 1 -1 
det(A3) 2| 1 0 -1|=-3. (3.3.14) 
-1 3 7 
Finally, 
2 1 — 
SS 2; ata = a 1, and z34- = = —3. (3.3.15) 


You can also use MATLAB to perform Cramer’s rule. In the present example, the script 
is as follows: 


clear; % clear all previous computations 

A-[212; 101; -1 3 -2]; % input coefficient matrix 
b = [7-1 ; -1; 7]; 4 input right side 

A1 = A; A1C:,1) = b; % compute A_1 

A2 = A; A2C:,2) = b; % compute A2 

A3 = A; A3(:,3) = b; % compute A.3 

^4 compute solution vector 

x = [det(A1), det(A2), det(A3)] / det(A) 


Problems 


Solve the following systems of equations by Cramer’s rule: 


1. zı +222 = 3, 32%, + 22 = 6 

2. 2%, + T2 = —3, 21— r= 1 

3. 221 — 939 = 7, 4x1— 52353 = 9 

4. 621 — 5x2 = 2, zı +2z2 = 7 

5. £1 +2z2 — 243 = 4, 2%, + £2 + £3 = —2, zı + T2 — z3 = 2 

6. 2z4 + 322 z3 = —1, zı —2%.+ £3 — 5, 321 — T2 = —2. 

7. x1 — 895 + £3 = 4, —z1 + 2x2 + 23 = 2, £1 — £2 + 2£3 = —1. 

8. 22, — 312 + 5x3 = 7, —421 + 4x2 — 813 = 9, 12%, + 725 — 1323 = 1T. 


Check your answer using MATLAB. 
3.4 ROW ECHELON FORM AND GAUSSIAN ELIMINATION 


So far, we assumed that every system of equations has a unique solution. This is not 
necessarily true, as the following examples show. 
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e Example 3.4.1 


Consider the system 
zı + t2 = 2 (3.4.1) 


and 
Qe, + 2x2 = —1. (3.4.2) 


This system is inconsistent because the second equation does not follow after multiplying 
the first by 2. Geometrically, Equation 3.4.1 and Equation 3.4.2 are parallel lines; they 
never intersect to give a unique xı and z2. 


e Example 3.4.2 


Even if a system is consistent, it still may not have a unique solution. For example, 
the system 
ti T X32 = 2 (3.4.3) 


and 


224 E 2x2 =4 (3.4.4) 


is consistent, with the second equation formed by multiplying the first by 2. However, there 
are an infinite number of solutions. 


Our examples suggest the following: 


Theorem: A system of m linear equations in n unknowns may: (1) have no solution, in 
which case it is called an inconsistent system, or (2) have exactly one solution (called a 
unique solution), or (3) have an infinite number of solutions. In the latter two cases, the 
system is said to be consistent. 


Before we can prove this theorem at the end of this section, we need to introduce some 
new concepts. 

The first one is equivalent systems. Two systems of equations involving the same 
variables are equivalent if they have the same solution set. Of course, the only reason 
for introducing equivalent systems is the possibility of transforming one system of linear 
systems into another that is easier to solve. But what operations are permissible? Also, 
what is the ultimate goal of our transformation? 

From a complete study of possible operations, there are only three operations for trans- 
forming one system of linear equations into another. These three elementary row operations 
are 


(1) interchanging any two rows in the matrix, 
(2) multiplying any row by a nonzero scalar, and 


(3) adding any arbitrary multiple of any row to any other row. 


Armed with our elementary row operations, let us now solve the following set of linear 
equations: 
X1 -— 322 + 7x3 = 2. (3.4.5) 
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221 4x5 323 = 1, (3.4.6) 


and 


—41 T 1322 ac 2123 — (3.4.7) 


We begin by writing Equation 3.4.5 through Equation 3.4.7 in matrix notation: 


pou 7 zi 2 
2 4 -3 zo | 2| il. (3.4.8) 
expo 13 vend. \ z3 2 


The matrix in Equation 3.4.8 is called the coefficient matrix of the system. 
We now introduce the concept of the augmented matrix: a matrix B composed of A 
plus the column vector b or 


jones XO 
B=[2 4 -3|-1|. (3.4.9) 
-1 13 —21| 2 


We can solve our original system by performing elementary row operations on the augmented 
matrix. Because x; functions essentially as a placeholder, we can omit them until the end 
of the computation. 

Returning to the problem, the first row can be used to eliminate the elements in the 
first column of the remaining rows. For this reason the first row is called the pivotal row 
and the element a1; is the pivot. By using the third elementary row operation twice (to 
eliminate the 2 and —1 in the first column), we have the equivalent system 


fem eS 
B-|o 10 -17|-5]. (3.4.10) 
0 10 14} 4 


At this point we choose the second row as our new pivotal row and again apply the third 
row operation to eliminate the last element in the second column. This yields 


pis. eS 
B=[0 10 -17|-5]. (3.4.11) 
Dou. 3 a9 


'Thus, elementary row operations transformed Equation 3.4.5 through Equation 3.4.7 into 
the triangular system: 


Tı — 322 T 7x3 = 2, (3.4.12) 
323 = 9, (3.4.14) 


which is equivalent to the original system. The final solution is obtained by back substitution, 
solving from Equation 3.4.14 back to Equation 3.4.12. In the present case, x3 = 3. Then, 
10x2 = 17(3) — 5, or x = 4.6. Finally, xı = 3x2 — 7z3 + 2 = —5.2. 

In general, any n x n linear system can be reduced to triangular form. This reduction 
involves n—1 steps. In the first step, a pivot element (or simply pivot), and thus the pivotal 
row, is chosen from the nonzero entries in the first column of the matrix. We interchange 
rows (if necessary) so that the pivotal row is the first row. Multiples of the pivotal row 
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are then subtracted from each of the remaining n — 1 rows so that there are 0’s in the 
(2, 1), ..., (n, 1) positions. In the second step, a pivot element (another pivot) is chosen from 
the nonzero entries in column 2, rows 2 through n, of the matrix. The row containing the 
pivot is then interchanged with the second row (if necessary) of the matrix and is used as 
the pivotal row. Multiples of the pivotal row are then subtracted from the remaining n — 2 
rows, eliminating all entries below the diagonal in the second column. The same procedure 
is repeated for columns 3 through n — 1. Note that in the second step, row 1 and column 
1 remain unchanged, in the third step the first two rows and first two columns remain 
unchanged, and so on. 

If elimination is carried out as described, we arrive at an equivalent upper triangular 
system after n — 1 steps. There are two possible outcomes. If all n pivots are nonzero, 
then the system of equations has a unique solution that we can obtain by performing back 
substitution. This reduction involves n — 1 steps. However, the procedure fails if, at any 
step, all possible choices for a pivot element equal zero. Let us now examine such cases. 

Consider now the system 


X1 + 2x5 + da = —1, (3.4.15) 
221 ae 422 S 2x3 = —2, (3.4.16) 
dr A9 T 2x3 = 2. (3.4.17) 
Its augmented matrix is 
T2 Dad 
B=|2 4 2|-2|. (3.4.18) 
142 2 


Choosing the first row as our pivotal row, we find that 


i soe ay 
B-[000|0], (3.4.19) 
02 1|3 
Or 
] os ub pest 
B=|0 2 1|3|. (3.4.20) 
0 0 0] 0 


The difficulty here is the presence of the zeros in the third row. Clearly any finite numbers 
satisfy the equation 02; +0x2+0az3 = 0 and we have an infinite number of solutions. Closer 
examination of the original system shows an underdetermined system; Equation 3.4.15 and 
Equation 3.4.16 differ by a multiplicative factor of 2. An important aspect of this problem 
is the fact that the final augmented matrix is of the form of a staircase or echelon form 
rather than of triangular form. 

Let us modify Equation 3.4.15 through Equation 3.4.17 to read 


X1 + 2x» + X3 = —1, (3.4.21) 
2x1 ae 439 ps 213 = 3, (3.4.22) 
Ly. 429 T 2x3 = 2; (3.4.23) 


then the final augmented matrix is 


(3.4.24) 
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We again have a problem with the third row because 0x4 +0£2+0£3 = 5, which is impossible. 
'There is no solution in this case and we have an inconsistent system. Note, once again, that 
our augmented matrix has a row echelon form rather than a triangular form. 

In summary, to include all possible situations in our procedure, we must rewrite the 
augmented matrix in row echelon form. We have row echelon form when: 


(1) The first nonzero entry in each row is 1. 


(2) If row k does not consist entirely of zeros, the number of leading zero entries in 
row k + 1 is greater than the number of leading zero entries in row k. 


(3) If there are rows whose entries are all zero, they are below the rows having 
nonzero entries. 


'The number of nonzero rows in the row echelon form of a matrix is known as its rank. In 
MATLAB, the rank is easily found using the command rank( ). Gaussian elimination is 
the process of using elementary row operations to transform a linear system into one whose 
augmented matrix is in row echelon form. 


e Example 3.4.3 


Each of the following matrices is not of row echelon form because they violate one of 
the conditions for row echelon form: 


27-22-93 
021 io : ee 3 (3.4.25) 
0 0 4 


e Example 3.4.4 


The following matrices are in row echelon form: 


oor 
[e E 
eR Ww 


14 6 1 4 0 
,{0 0 1],[ 0 1 3). (3.4.26) 
00 0 0 0 0 


e Example 3.4.5: Gauss-Jordan elimination 


Gaussian elimination can also be used to solve the general problem AX — B. A 
particular popular form is Gauss-Jordan elimination. In this particular form of Gaussian 
elimination, row reduction is continued until the A matrix consists of elements equaling 1 
along the principal diagonal and all of the other elements equal zero, yielding a reduced row 
echelon. It is commonly used to find the inverse of a matrix. 

Let us find the inverse of the matrix 


A=|-2 -4 4 (3.4.27) 
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by Gaussian elimination. 
Because the inverse is defined by AA~! = I, our augmented matrix is 


4 —2 2|1 0 0 
-2 —4 b ye 1 0]. (3.4.28) 
-4 2 8|00 1 


4 —2 2|1 0 0 zo —4 4|0 1 0 
—2 —4 od 1 oļ=| 4 —2 2l1 0 0 (3.4.29) 
—4 2 OR 0 1 —4 2 80o 0 1 
-2 —4 ABO. 1 0 
={ 4 -2 2]1 0 0 (3.4.30) 
0 0 10/1 01 
zo —4 4|0 10 
=| 0 -10 10|1 2 0 (3.4.31) 
o 0 10101 
zx ds CANO: 0 
=| o ~10 0 core 2 usn (3.4.32) 
o 0 10|10 1 
-2 —4 0ļ|-2/55 1 -2/5 
=| o0 ~—10 0f 0 2 ~i (3.4.33) 
0 0 10 1 0 1 
-9- 0 | 2225- 1⁄5 0 
=| o -1 0 0 2 -1 (3.4.34) 
o o0 10 od. X 


1 0 0|1/5 -1/10 0 
=/0 1 0] 0  -1/5 1/10]. (3.4.35) 
0 0 1/1/10 0 1/10 


'Thus, the right half of the augmented matrix yields the inverse and it equals 


1/5 -1/10 0 
A!-[| 0 -1/5 1/10}. (3.4.36) 
1/10 0 1/10 


MATLAB has the ability of doing Gaussian elimination step by step. We begin by 
typing: 
>>% input augmented matrix 
>>aug = [4 -2 2 1 00 ; -2 -4 4 0 1 0;-4 28001]; 
>>rrefmovie (aug); 

The MATLAB command rrefmovie(A) produces the reduced row echelon form of A. 
Repeated pressing of any key gives the next step in the calculation along with a statement 
of how it computed the modified augmented matrix. Eventually you obtain 


A= 
1 0 0 1/5 -1/10 0 
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0 1 0 0 -1/5 1/10 
0 0 1 1/10 0 1/10 


You can read the inverse matrix just as we did earlier. 


Gaussian elimination may be used with overdetermined systems. Overdetermined sys- 
tems are linear systems where there are more equations than unknowns (m > n). These 
systems are usually (but not always) inconsistent. 


e Example 3.4.6 


Consider the linear system 


zı + T2 = 1 (3.4.37) 


After several row operations, the augmented matrix 


1 Pi) Sat 
= a (3.4.40) 
1 -1|4 
becomes 
1 1| 1 
0 d 2 J. (3.4.41) 
0 0| -7 


From the last row of the augmented matrix, Equation 3.4.41, we see that the system is 
inconsistent. 
If we test this system using MATLAB by typing: 
>>% input augmented matrix 
>>aug = [1 1 1 ; -1 2 -2; 1 -1 4]; 
>>rrefmovie (aug); 


eventually you obtain 


A= 
1 0 0 
1 0 
0 0 1 


Although the numbers have changed from our hand calculation, we still have an inconsistent 
system because zı = x2 = 0 does not satisfy zı + 12 = 1. 
Considering now a slight modification of this system to 


zı +2 =l, (3.4.42) 
zı = —1, (3.4.44) 
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the final form of the augmented matrix is 


1 1|1 
0 1:2], (3.4.45) 
0 0/0 

which has the unique solution zı = —1 and x2 = 2. 


How does MATLAB handle this problem? Typing: 


>>% input augmented matrix 
>>aug = [1 1 1 ; -1 2 5; 10 -1]; 
»»rrefmovie(aug); 


we eventually obtain 


A = 


m" 
N 


This yields xı = —1 and x2 = 2, as we found by hand. 
Finally, by introducing the set: 


Tı + T2 = 1, (3.4.46) 
224 T 2x9 = 2, (3.4.47) 
321 Ex 323 = 3, (3.4.48) 


the final form of the augmented matrix is 


1 
0 (3.4.49) 
0 


oor 
oor 


There are an infinite number of solutions: xı = 1 — a, and x2 = a. 
Turning to MATLAB, we first type: 


>>% input augmented matrix 
>>aug = [1 1 1 ; 222; 3 3 3]; 
>>rrefmovie (aug); 


and we eventually obtain 


A= 
1 1 1 
0 0 0 
0 0 0 


'This is the same as Equation 3.4.49 and the final answer is the same. 


Gaussian elimination can also be employed with underdetermined systems. An under- 
determined linear system is one where there are fewer equations than unknowns (m « n). 
These systems usually have an infinite number of solutions although they can be inconsis- 
tent. 
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e Example 3.4.7 


Consider the underdetermined system: 


221 + 2x2 + da = —1, (3.4.50) 
4a, + 4x3 + 223 = 3. (3.4.51) 


Its augmented matrix can be transformed into the form: 
2 2 1|-1 
r 0 1 5 | (3.4.52) 
Clearly, this case corresponds to an inconsistent set of equations. On the other hand, if 
Equation 3.4.51 is changed to 
421 + 4x5 + 213 = —2, (3.4.53) 


then the final form of the augmented matrix is 


2 2 1|-1 
D 0 B 0 ) (3.4.54) 
and we have an infinite number of solutions, namely z3 = a, x? = B, and 22, = —1— a — 2B. 
We can write this solution as 
X1 -i -i —i 
x—-[z|21| 0 J+al 0 | 8| 1 |. (3.4.55) 
X3 0 1 0 


Consider now one of the most important classes of linear equations: the homogeneous 
equations Ax = 0. If det(A) Æ 0, then by Cramer's rule 7, = £2 = z3 = ++: = Zn = 0. 
Thus, the only possibility for a nontrivial solution is det(A) = 0. In this case, A is singular, 
no inverse exists, and nontrivial solutions exist but they are not unique. 


e Example 3.4.8 
Consider the two homogeneous equations: 


Ly + T2 = 0, (3.4.56) 
Tı — 22 = 0. (3.4.57) 


Note that det(A) = —2. Solving this system yields zı = z2 = 0. 
On the other hand, if we change the system to 


1 T T2 = 0, (3.4.58) 
Tı 22 = 0, (3.4.59) 
which has the det(A) = 0 so that A is singular. Both equations yield zı = —z» = o, 


any constant. Thus, there is an infinite number of solutions for this set of homogeneous 
equations. 


124 Advanced Engineering Mathematics with MATLAB 


e Example 3.4.9: Null space 


At this point it is convenient to introduce the concept of null space: For an m x n 
matrix A, the null space is the set of solutions to the homogeneous system Ax = 0. 
Consider the matrix 
2 2 1 
A-|[44 2]. (3.4.60) 


'To find its null space we first set up the augment matrix 


2 2 1|0 
4 4 2/0]. (3.4.61) 
0 0 0|0 


2 2 1|0 
0 0 0/0 (3.4.62) 
0 0 0/0 


and the solution to our homogeneous equations can be written 


1 
X1 —9 —1 
x=[a}]=al 0 |-«8| 1 |. (3.4.63) 
T3 1 0 


Thus, the null space for the matrix A consists of two vectors: 


-i —1 
0 and 1 
1 0 


Let us return to Example 3.4.7. There we solved the system Ax = b where A is given 
by Equation 3.4.60, x = (xı x2 x3)", and b = (—1 3 0)T. We found that its general 
solution, given by Equation 3.4.55, contained two parts: the particular solution (-i 0 0)7 
and a general solution consisting of two terms. Each term equaled a free constant times a 
vector from the null space. 


We close this section by outlining the proof of the theorem, which we introduced at 
the beginning. 
Consider the system Ax — b. By elementary row operations, the first equation in this 
system can be reduced to 
£1 + 01222 d: + Qintn = Br. (3.4.64) 
'The second equation has the form 
Tp + O2p-4-1Tp4-1 tet as = Bo, (3.4.65) 


where p > 1. The third equation has the form 


Tq + O3q41€g41 +++ + A3nXn = p3, (3.4.66) 
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where q > p, and so on. To simplify the notation, we introduce z; where we choose the 
first k values so that z1 = £1, 22 = £p, 23 = £q, .... Thus, the question of the existence of 
solutions depends upon the three integers: m, n, and k. The resulting set of equations has 
the form: 


l 2 Yik Taxe Pat ua zy By 
0 - Ll. Yak Yakti ` Yn 22 Ba 
0 0 eee 1 Yeka eee Fkn Zk = Br : (3.4.67) 
0 0 0 0 0 Žk+1 Br+i 
0 0 - Q0 0 mrs) Zn Bm 
Note that 6,41, ..., Bm need not be all zeros. 
'There are three possibilities: 
(a) k < m and at least one of the elements £,.,1,...,/8,, is nonzero. Suppose that an 


element 5, is nonzero (p > k). Then the pth equation is 
021 + 022 +++ + 0zn = Bp £0. (3.4.68) 


However, this is a contradiction and the equations are inconsistent. 

(b) k = n and either (i) k < m and all of the elements 6,41,..., 8m are zero, or 
(ii) k = m. Then the equations have a unique solution that can be obtained by back- 
substitution. 


(c) k < n and either (i) k < m and all of the elements 6;41,...,m are zero, or (ii) 
k =m. Then, arbitrary values can be assigned to the n — k variables zy41,...,24. The 
equations can be solved for 21, 22,..., 2% and there is an infinity of solutions. 


For homogeneous equations b = 0, all of the 8; are zero. In this case, we have only 
two cases: 

(b^ k = n, then Equation 3.4.67 has the solution z = 0, which leads to the trivial 
solution for the original system Ax = 0. 

(c) k < n, the equations possess an infinity of solutions given by assigning arbitrary 
values to Zy.41,... Zn. 


Problems 


Solve the following systems of linear equations by Gaussian elimination. Check your answer 
using MATLAB. 


1. 224 + 29 = 4, 5x21 — 2%2 = 1 

2. 24 + 29 = 0, 321 — 4259 = 1 

3. —24 + $9 + 223 = 0, 324 + 4x9 + 23 = 0, —24- 394-223 = 0 

4. 421 + 612 + 13 = 2, 214 + £2 — A3 = 3, 321 — 219 4-523 = 8 

5. 3x1 + T2 — 213 = —3, Z1 — £2 +243 = —1, —42z1 + 322 — 673 = 4 
6. 21 — 3x2 + 7x3 = 2, 221 + 4x2 — 323 = —1, —821 + Tz9 + 2273 = 3 
T. £1 — £2 + 323 = 5, 2:1 — 4x2 + 7x3 = 7, 4r, — 9x25 + 2x3 = —15 
8. £1 + £2 + £3 + g4 =—l, 24, — z2 + 323 = 1, 


219 + 3x4 = 15, —2, +242 + T4 = —2 
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Find the inverse of each of the following matrices by Gauss-Jordan elimination. Check your 
answers using MATLAB. 


19 2 -9 1 2 5 
9. E 1) 10. = a] 11. [-4 -1 2 12. [0 -1 2 
—2 0 1 2 4 11 


13. Does (42)! = (A~!)?? Justify your answer. 
Project: Solving Fredholm Integral Equations of the Second Kind 


Fredholm integral equations of the second kind and their variants appear in many 
scientific and engineering applications. In this project you will use matrix methods to solve 
this equation: 


b 
u(x) aj K (a, t)u(t) dt + f(x), a « x « b, 


where the kernel K(z,t) is a given real-valued and continuous function and u(x) is the 
unknown. One method for solving this integral equation replaces the integral with some 
grid-point representation. The goal of this project is to examine how we can use linear 
algebra to solve this numerical approximation to this integral equation. 


Step 1: Using Simpson's rule, show that our Fredholm equation can be written in the matrix 
form (I — K D)u = f, where 


Ao 0 0 0 
0 A, 0 0 
D- : l 
0 0 Anı 0 
0 0 0 An 
K (xo, Xo) K(@o,t1) > = K(a0,%n-1) K (xo, £n) 
K (21,20) Aha est EQUOS. K(zi;t4) 
K= : : z : ; 
K(£n-1, £0) K (2451,21) reb. K (x51, 4-1) K(@n-1,2n) 
Ks Xe) «Bata © ae a) A Cb eds) 


u= [u(xo), u(z1), "rS pum. and f— [f (xo); f(21), Ur TG". 


where Ap = Ay = h/3, A» A4 fes An-2 2h/3, Aj As vat Ana 4h/3, 
zi = ih, and h = (b — a)/n. Here n must be an even integer. 


Step 2: Use MATLAB to solve our matrix equation to find u. Use the following known 
solutions: 


(a) K(x,t) x^. f(x) = 0.927, u(x) = z?, 
(b) Kat) ege. f(x) 2 x4 (1- z)e*, u(x) = e”, 
(c) Kd) e, f(x) = $e", u(x) = e”, 
(d) K(a,t) = — 4e?2—5t/3, f(x) = exp(2z + 3), u(z) = e°”, 
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|relative error| 


Figure 3.4.1: The absolute value of the relative error of the numerical solution of a Fredholm integral 
equation of the second kind as a function of n for test problems (a), (b), (d), and (e). 


(e) K(z,t) = —c (e** — 1), f(x) =e —- v, u(x) = 1, 

(f) K(a,t) = lat, f(z) = $a, u(z) = z, 
when 0 < x < 1. How does the accuracy of this method vary with n (or h)? What happens 
when n becomes large? Figure 3.4.1 shows the absolute value of the relative error in the 


numerical solution at « = 3 as a function of n. For test cases (c) and (f) the error was the 
same order of magnitude as the round-off error. 


Project: LU Decomposition 


In this section we showed how Gaussian elimination can be used to find solutions to sets 
of linear equations. A popular alternative involves rewriting the n x n coefficient matrix: 


11 12 13 eee eee eee Ain 
21 22 23 eee eee eee An 
A= i 
Qij 
Ani An2  Qn3 = mE UC Ann 


as the product of a lower n x n triangular matrix: 


fi 0 0 0 0 0 0 
fo, £29 0 0 0 0 0 

£31 £32 f33 0 0 0 0 

fa 2 ox 5 0 0 0 
li; 0 0 

: 0 


bni bna bng c cee 00 ban 
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and an upper n x n triangular matrix: 


l ug u3 14 5 Uin 

0 1 U23 U24 U25 U2n 

0 0 1 34 U35 U3n 
U-|0 0 0 1l was UAn, , 

0 0 0 0 qp Fe 


so that A — LU. By simply doing the matrix multiplication, we find the following Crout 
algorithm to compute £;; and uij: 


j—1 
bean SLi. $4 i=1,2,...,n; 
k=1 


and 
i—1 
Wig = fes- 3n] /ns CRG J 9,9, slog Ms 
k=1 


For the special case of j = 1, €; = aj; for i = 1, u4; = a1; /C11 = ai1/a11. Clearly we could 
write code to compute L and U given A. However, MATLAB has a subroutine for doing this 
factorization [L,U] = lu(A). 


Note: If you use [L,U] = lu(A), L may not be a lower triangular matrix as shown above 
but still A = L*U. For example, if A = [4,3;6,3], [L,U] = 1u(A) yields the lower trian- 
gular matrix L = [0.667,1;1,0], U = [6,3;0,1], and A = L*U. But, L = [1,0;1.5,1] 
and U = [4,3;0,-1.5] also gives A = LU and L and U do conform to our format. If you 
want to use MATLAB you must use the decomposition that it gives you. 


How does this factorization help us to solve Ax = b? The goal of this project is to answer 
this question. 


Step 1: Show that Ly = b and Ux = y can be combined together to yield Ax = b. 


Step 2: Write a MATLAB script to solve Ax = b using LU decomposition. Hint: Use y = 
L\b and x = U\y rather than the MATLAB function inv. 


Step 3: Check your program by resolving Problems 4, 6, 7, and 8. 


The principal reason that this scheme is so popular is its economy of storage. The 0’s 
in either L or U are not stored. Furthermore, after the element aj; is used, it never appears 
again. 


Project: QR Decomposition 


In the previous project, you discovered that by factoring the matrix A into upper and 
lower diagonal matrices, we could solve Ax = b. Here we will again factor the matrix A 
into the product QR, but Q will have the property that QTQ = I (orthogonal matrix) and 
R is an upper triangular matrix. 
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Step 1: Assuming that we can rewrite Ax = b as QRx = b, multiply both sides of this 
second equation by Q7 and show that you obtain Rx — QTb — y. 


Step 2: Show that x; can be computed from £n = Yn/Tnn and 


T 
Ti = Vi — 5 TijYj [rs t=n-—1,n-2,...,1. 


j=i+1 


Step 3: Write a MATLAB script to solve Ax = b using QR decomposition. Note that 
MATLAB has the subroutine qr for QR decomposition of a matrix A. 


Step 4: Check your program by resolving Problems 4, 6, 7, and 8. 


What advantages does QR decomposition have over LU decomposition? First, solving 
Ax = b via Rx = QTb is as well-conditioned as the original problem. Second, QR decom- 
position finds the least-squares solutions when no exact solution exists. When there are 
exact solutions, it finds all of them. 


3.5 EIGENVALUES AND EIGENVECTORS 


One of the classic problems of linear algebra? is finding all of the A's that satisfy the 
n X n system 
Ax = Ax. (3.5.1) 


The nonzero quantity A is the eigenvalue or characteristic value of A. The vector x is the 
eigenvector or characteristic vector belonging to A. The set of the eigenvalues of A is called 
the spectrum of A. The largest of the absolute values of the eigenvalues of A is called the 
spectral radius of A. 

To find A and x, we first rewrite Equation 3.5.1 as a set of homogeneous equations: 


(A— AD)x — 0. (3.5.2) 


From the theory of linear equations, Equation 3.5.2 has trivial solutions unless its determi- 
nant equals zero. On the other hand, if 


det(A — AI) — 0, (3.5.3) 


there is an infinity of solutions. 

'The expansion of the determinant, Equation 3.5.3, yields an nth-degree polynomial in A, 
the characteristic polynomial. The roots of the characteristic polynomial are the eigenvalues 
of A. Because the characteristic polynomial has exactly n roots, A has n eigenvalues, some 
of which can be repeated (with multiplicity k < n) and some of which can be complex 
numbers. For each eigenvalue A;, there is a corresponding eigenvector x;. This eigenvector 
is the solution of the homogeneous equations (A — A;I)x; = 0. 

An important property of eigenvectors is their linear independence if there are n distinct 
eigenvalues. Vectors are linearly independent if the equation 


01X1 T 02X2 +- +AnXn — 0 (3.5.4) 


6 The standard reference is Wilkinson, J. H., 1965: The Algebraic Eigenvalue Problem. Oxford Univer- 
sity Press, 662 pp. 
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can be satisfied only by taking all of the coefficients a, equal to zero. 

'This concept of linear independence or dependence actually extends to vectors in gen- 
eral, not just eigenvectors. Algebraists would say that our n linearly independent vectors 
form a basis that spans a vector space V. A vector space is simply a set V of vectors that 
can be added and scaled. The maximum number of linearly independent vectors in a vector 
space gives its dimension of V. A vector space V can have many different bases, but there 
are always the same number of basis vectors in each of them. 

Returning to the eigenvalue problem, we now show that in the case of n distinct eigen- 
values À1, A2,..., An, each eigenvalue A; having a corresponding eigenvector x;, the eigen- 
vectors form a basis. We first write down the linear dependence condition 


01Xj + Q2X2 t c o X4 = 0. (3.5.5) 
Premultiplying Equation 3.5.5 by A, 
ay Ax, + Q3 Axe +++: + An ÅXn = a1 A1X1 + Q2ÀA2X2 + -© + AnAnXn = 0. (3.5.6) 
Premultiplying Equation 3.5.5 by A?, 
ay A?x4 + a2 A? x3 4-7 +0, A Xn = o1À2xi + a2A3X2 Tec Ond2Xn = 0. (3.5.7) 


In a similar manner, we obtain the system of equations: 


1 1 ee 1 01Xj 0 
Al A2 fee Àn Q2X»5 0 
MO XM oo An a3x3 | 2 | 0], (3.5.8) 
Apt ADIT A and AnXn 0 
Because 
1 1 MM 1 
CH E (Races ese A Su ue Ao 
Al A2 we An A25 A) Aa Aa) Os = A) Aa Ag 359 
3 : ; (A4 — A2) +++ (An — A1) #9, (989) 
XT OP pat 
since it is a Vandermonde determinant, a,x, = Q2X2 = Q3X3 = ::: = AnXn = 0. Because 
the eigenvectors are nonzero, o4 ag a3 ee An 0, and the eigenvectors are 


linearly independent. 


This property of eigenvectors allows us to express any arbitrary vector x as a linear 
sum of the eigenvectors xj, or 


X = Cy Xy + CoXQ +++ + CnXn.- (3.5.10) 


We will make good use of this property in Example 8.5.1. 
e Example 3.5.1 


Let us find the eigenvalues and corresponding eigenvectors of the matrix 


A= e n (3.5.11) 
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We begin by setting up the characteristic equation: 


—4—A 2 


det(A — AI) = wi EGO 0. (3.5.12) 
Expanding the determinant, 
(-4— \)(—1 — A) +2 = M + 5A +6 = (AF 3)(A4 2) = 0. (3.5.13) 
Thus, the eigenvalues of the matrix A are À; = —3, and As = —2. 


'To find the corresponding eigenvectors, we must solve the linear system: 
—4—A 2 x 0 
( zd v teeta (3.5.14) 
-1 2 x 0 
aNg = 


For example, for A; = —3, 


Thus, any nonzero multiple of the vector G 


Ji is an eigenvector belonging to A; = —3. 


Similarly, for A2 = —2, the eigenvector is any nonzero multiple of the vector íi 


Of course, MATLAB will do all of the computations for you via the command eig, which 
computes the eigenvalues and corresponding eigenvalues. In the present case, you would 
type: 
>> A = [-4 2; -1 -1]; % load in array A 
>> % find eigenvalues and eigenvectors 


>> [eigenvector,eigenvalue] = eig(A) 
This yields: 
eigenvector = 
-0.8944 -0.7071 
-0.4472 -0.7071 
and 
eigenvalue = 
-3 0 
0 -2. 


The eigenvalues are given as the elements along the principal diagonal of eigenvalue. 
The corresponding vectors are given by the corresponding column of eigenvector. As 
this example shows, these eigenvectors have been normalized so that their norm, Equation 
3.1.5, equals one. Also, their sign may be different than any you would choose. We can 
recover our hand-computed results by dividing the first eigenvector by —0.4472 while in 
the second case we would divide by —0.7071. Finally, note that the product eigenvec- 
tor*eigenvalue*inv(eigenvector) would yield A. 
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e Example 3.5.2 


Let us now find the eigenvalues and corresponding eigenvectors of the matrix 


—4 5 5 
A=|{-5 6 5]. (3.5.17) 
—5 5 6 
Setting up the characteristic equation: 
—4—AÀ 5 5 —4— A 5 5 
det(A — AI) 2| —5 6—A 5 |=] —5 6—A 5 (3.5.18) 
—5 5 6—A 0 A-1 1—A 
—4—A 5 5 -1 1 0 
= (A- 1) 5 6-A B5 -—(A-1?|-5 6-A 5. (3.5.19) 
0 1 -1 0 1 -1 
-1 0 0 
=(A-1)?|-5 6-A 0 |-(A-1Y(6—2)-0. (3.5.20) 
0 1 -1 


Thus, the eigenvalues of the matrix A are 41,9 = 1 (twice), and A3 = 6. 
'To find the corresponding eigenvectors, we must solve the linear system: 


(—4 TX A)zi + 5x9 p 5x3 = 0, (3.5.21) 
—52r1 xu (6 = A) x2 SE 5x3 = 0, (3.5.22) 

and 
5x1 + 5x9 4 (6 A)zs = 0. (3.5.23) 


For A3 = 6, Equations 3.5.21 through 3.5.23 become 


—10z, + 512 + 513 = 0, (3.5.24) 
—521 EE 5x3 = 0, (3.5.25) 
and 
—5241 Fle 5x» =0. (3.5.26) 
1 
Thus, z; = x2 = x3 and the eigenvector is any nonzero multiple of the vector | 1 


1 
The interesting aspect of this example centers on finding the eigenvector for the eigen- 
value A1,5 = 1. If 41.2 = 1, then Equations 3.5.21 through 3.5.23 collapse into one equation, 


—£1ı + T2 + T3 = 0, (3.5.27) 


and we have two free parameters at our disposal. Let us take r9 = a, and z3 = B. Then 
1 1 

the eigenvector equals a | 1 | -8| 0 | forà12 — 1. 
0 1 
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1 1 
In this example, we may associate the eigenvector | 1 | with A; = 1, and | 0 | with 
0 1 
1 
1 
1 
independent eigenvectors for our 3 x 3 matrix. However, with repeated eigenvalues this is 


not always true. For example, 
1 -l 
A= c 1 ) (3.5.28) 


has the repeated eigenvalues A,» = 1. Still, there is only a single eigenvector e for both 


i and A2. 
What happens in MATLAB in the present case? Typing in: 


>> A= [-4 5 5; -5 6 5; -5 5 6]; % load in array A 
>> % find eigenvalues and eigenvectors 


À2 = 1 so that, along with the eigenvector with A3 = 6, we still have n linearly 


>> [eigenvector,eigenvalue] = eig(A) 
we obtain 
eigenvector = 
-0.8165 0.5774 0.4259 
-0.4082 0.5774 -0.3904 
-0.4082 0.5774 0.8162 
and 
eigenvalue = 
1 0 0 
0 6 0 
0 0 1 


The second eigenvector is clearly the same as the hand-computed one if you normalize it with 
0.5774. The equivalence of the first and third eigenvectors is not as clear. However, if you 
choose a = 2 = —0.4082, then the first eigenvector agrees with the hand-computed value. 
Similarly, taking a = —0.3904 and 6 = 0.8162 result in agreement with the third MATLAB 
eigenvector. Finally, note that the product eigenvector*eigenvalue*inv (eigenvector) 
would yield A. 


e Example 3.5.3: Diagonalization of a matrix A with distinct eigenvalues 


Consider an n x n matrix A which has n distinct eigenvalues A1,A2,---, An and n 
corresponding (and distinct) eigenvectors pi,po,:::, ps. If we introduce a matrix P = 
[p1p2 ::: Pn] (the eigenvectors form the columns of P), called the modal matrix, and recall 
that Pp; — Ajp;, then 


AP = A[pip2 --: pa] = [Ap1 Ap2--: Apa] = Daupi2opo + AnPnl- (3.5.29) 


Therefore, AP = PD, where 


pue (3.5.30) 
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Because P has rank n, P~! exists and D = P-!AP. Therefore, performing the operation 
g 


P—!AP is a process by which we can diagonalize the matrix A using the eigenvectors of A. 
Diagonalizable matrices are of interest because diagonal matrices are especially easy to use. 
Finally, we note that 


D? = DD = P7 APP AP =P AAP = PAP. (3.5.31) 


Repeating this process, we eventually obtain the general result that D™ = P~'A™P. 
To verify P-1 AP = D, let us use 


3 4 
4-( "E (3.5.32) 
This matrix has the eigenvalues A15 = 1,5 with the corresponding eigenvectors p; = 
(2 —1)" and pp=(2 1)”. Therefore, 
af 3:2 —ı (M4 -Af2 
p-(2 P) amt e-(U HP). auam 
Therefore, 
p-!4p = 1/4 -1/2 3 4 2 2\ [f(1l/4A -1/2 2 10\ [1 0 
| V1/A 1/2 1 3/\-1 1} 1⁄4 1/2 -1 5) \0 5J’ 
(3.5.34) 


Similarly, if we are given D and P for an n x n matrix A, we can express A as the 
product PDP-! and A" = PD" p-1, 


Problems 


Find the eigenvalues and corresponding eigenvectors for the following matrices. Check your 
answers using MATLAB. 


3 2 Bes ER LE 
iae A 2. A= (7 T) 3. A=(5 » 


iras 2 —3 1 0 1 0 
&A- (3 2) 5. A=]1 -2 1 6 A—-[|[0 0 1 
1 -3 2 00 0 
11 1 12 1 4 —5 1 
7.A—-|0 2 1 8 A-2|0 3 1 9 A={1 0 -1 
001 0 5 -1 0 1 -1 
—2 0 1 2.00 —3 1 1 
10. A=| 3 0 -1 11. A=|1 0 2 12. A=| 0 0 0 
0 1 1 00 3 0 1 0 
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Project: Singular Value Decomposition (SVD) and Linear Least Squares 


In projects at the end of Section 3.4 we showed two ways that linear equations can be 
solved by factoring the matrix A in Ax — b into a product of two matrices. The LU and 
QR decompositions are not the only possible factorization. One popular version rewrites 
the square matrix A as PDP~!, where D is a diagonal matrix with the n eigenvalues along 
the principal diagonal and P contains the eigenvectors. MATLAB’s routine eig yields both 
D and P via [P,D] = eig(A). See Example 3.5.2, for example. In this project we focus on 
singular value decomposition, possibly the most important matrix decomposition of them 
all. It is used in signal processing, statistics, and numerical methods and theory. 

Singular value decomposition factors a matrix A of dimension m x n into the product 
of three matrices: A = U DVT, where U is an m x m orthogonal matrix, V is an n x n 
orthogonal matrix, and D is an m x n diagonal matrix. The diagonal entries of D are called 
the singular values of A. The rank of a matrix equals the number of non-zero singular 
values. 

Consider the matrix B given by 


45  —108 36  —45 
21  —68 26 —33 
B=] 72 —32 —-16 24 
—56 64 —8 8 
50 —32 —6 10 


Using MATLAB’s subroutine svd, confirm that it can factor the array B into U, D, and V. 
Then check that B = U DVT and find the rank of this matrix. 


Let us now seek to find the parameters 8 and y so that the line y = £z + y gives the 
best fit to n data points. If there are only two data points, there is no problem because we 
could immediately find the slope @ and the intercept y. On the other hand, if n > 2 the 
question immediately arises as to the best method for computing 6 and y so that a straight 
line best fits the data. How does singular value decomposition come to the rescue? 


To find the answer, we begin by noting that each data point (xi, yi) must satisfy the 
linear equation fr; +Y = yi, or 


tı 1 zı 1 yı 

T2 1 z2 1 ya 
24 

Zn 1 Yn 1 Un 


We can write this over-determined system of linear equations Ax — y. Ideally we would like 
to choose our vector x so that it yields the smallest Euclidean norm of the residual Ax — y; 
such a solution fits the data in the linear “least-squares sense.” Denoting this solution by 
x", we have that Ax" z y. Using singular decomposition we can rewrite this system as 
UDVTx* x y or x* x VD-!UTy. 


Step 1: Show that the rank for the matrix A is 2. 


Step 2: In Step 1, we found that the rank for the matrix A is 2. What values of x* 
does singular value decomposition give if y = (—2 446 —4 yg This solution equals the 
least-squares solution of minimum length. 
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X 


Figure 3.5.2: Using 50 "data points," the singular value decomposition (SVD) provides a least-squares fit 
to the data. 


Step 3: Returning to our original goal of finding the best linear fit to data, create data 
for your numerical experiment. One way would use the simple line y = 6x + (with 
arbitrarily chosen values of 8 and y) to create the initial data and then use the random 
number generator rand to modify this initial data (both x and y) so that both have “noise.” 


Step 4: Using your data, construct the array A and column vector y. Using the MATLAB 
routine svd, find x* = VD-!UTy. An alternative method is to first find M = trans- 
pose(A)*A followed by x = inv(M)*transpose(A)*b. Why does alternative method work? 


Step 5: Construct the least-squares fit for the data and plot this curve and your data on 
the same figure. See Figure 3.5.2. 


Step 6: Singular value decomposition is not the only method to solve for x. We could also 
use MATLAB’s backslash to find x = A\y where MATLAB uses the QR factorization to find 
the inverse. Compare this method of finding 8 and y with your singular value decomposition 
results. 


Step 7: Sometimes a linear fit is not appropriate and we should use a higher-order expansion, 
for example y = ôx? + Bx + y. Redo Steps 3 to 6 to find ô, 6 and y for noisy data where 
the initial data fits a quadratic. 


3.6 SYSTEMS OF LINEAR DIFFERENTIAL EQUATIONS 


In this section we show how we may apply the classic algebraic eigenvalue problem to 
solve a system of ordinary differential equations. 
Let us solve the following system: 


zi = 214+ 322, (3.6.1) 


and 
r5 = 32,4 12, (3.6.2) 


where the primes denote the time derivative. 
We begin by rewriting Equation 3.6.1 and Equation 3.6.2 in matrix notation: 


x’ = Ax, (3.6.3) 
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x= ay and A= € ar (3.6.4) 


zi d T1 eo 
(3)- 3(2) ax. es 


Assuming a solution of the form 


where 


Note that 


x = xe’, where Xo = n (3.6.6) 


is a constant vector, we substitute Equation 3.6.6 into Equation 3.6.3 and find that 
Ae* xo = Ae" xo. (3.6.7) 
Because e* does not generally equal zero, we have that 
(A — AD)xo = 0, (3.6.8) 


which we solved in the previous section. This set of homogeneous equations is the classic 
eigenvalue problem. In order for this set not to have trivial solutions, 


aa -an= | 5? 12, |=¢ (3.6.9) 
Expanding the determinant, 
(1—A)?-9=0 or A=-2,4. (3.6.10) 
Thus, we have two real and distinct eigenvalues: A = —2 and 4. 


We must now find the corresponding xo or eigenvector for each eigenvalue. From 
Equation 3.6.8, 


(1— A)a + 3b = 0, (3.6.11) 
and 

3a + (1— A)b = 0. (3.6.12) 
If A = 4, these equations are consistent and yield a = b = cı. If A = —2, we have that 
a = —b = c2. Therefore, the general solution in matrix notation is 


xa B" etc e ek (3.6.13) 


To evaluate cı and c», we must have initial conditions. For example, if z4(0) = z5(0) = 


1, then 
(ys Gea) (3.6.14) 


Solving for c4 and cg, c1 = 1, co = 0, and the solution with this particular set of initial 


conditions is 
x= (1) Eg (3.6.15) 
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e Example 3.6.1 
Let us solve the following set of linear ordinary differential equations 
d = —T2 + T3, 


x = 4r, — £2 — Axa, 


and 
x3 = —3zi— £2 4x3; 
or in matrix form, 
0 —1 1 X1 
x = 4 —1 -4]x, x= | x2 
—3 -1 4 X3 
Assuming the solution x = xge*, 
0 —1 1 
4 —] -4 xo = AXo, 
-3 -1 4 
or 
—A —1 1 
4 —1—-A -4 |xo=0 
3 1 4—A 
For nontrivial solutions, 
—A —1 1 0 0 1 
4 —1—A —4]|= 4 — 4A —5—AÀ —4 |=0, 
3 1 4— x 3+4\—-d7 3-A 4-A 


and 
(A—1)(A—3)(A4+1) =0, or A—-1,1,3. 


'To determine the eigenvectors, we rewrite Equation 3.6.21 as 
—Aa —b-- c— 0, 


4a — (1+ A)b — 4c = 0, 


and 
—3a — b + (4 — A)e = 0. 


For example, if A = 1, 
—a—b+c=0, 


4a — 2b — 4e = 0, 


and 
—3a — b + 3c = 0; 


(3.6.16) 


(3.6.17) 


(3.6.18) 


(3.6.19) 


(3.6.20) 


(3.6.21) 


(3.6.22) 


(3.6.23) 


(3.6.24) 


(3.6.25) 


(3.6.26) 


(3.6.27) 


(3.6.28) 


(3.6.29) 
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1 
or a = c, and b = 0. Thus, the eigenvector for A = 1 is xo = | 0 |. Similarly, for A = —1, 
1 
1 1 
Xo = | 2 |; and for \=3, xo = | —1 |. Thus, the most general solution is 
1 2 
1 1 1 
x=c, | 0 |e’t+e | 2] e*+e3 | —1 | e*. (3.6.30) 
1 1 2 


e Example 3.6.2 


Let us solve the following set of linear ordinary differential equations: 


x = £1 — 240, (3.6.31) 
and 
xh = 2x1 — 312; (3.6.32) 
or in matrix form, 
po 1 -2 = X1 
x = (5 23]? ek pe (3.6.33) 
Assuming the solution x = xge*, 
ara E (3.6.34) 
For nontrivial solutions, 
1—A uS T PA 2 
| J PUN EE - 0. (3.6.35) 
Thus, we have the solution 
x—a (1) et. (3.6.36) 


The interesting aspect of this example is the single solution that the traditional ap- 
proach yields because we have repeated roots. To find the second solution, we try the 


solution 
x= uu) g^ (3.6.37) 


We guessed Equation 3.6.37 using our knowledge of solutions to differential equations when 
the characteristic polynomial has repeated roots. Substituting Equation 3.6.37 into Equa- 
tion 3.6.33, we find that c = d = 2c2, and a — b = cg. Thus, we have one free parameter, 
which we choose to be b, and set it equal to zero. This is permissible because Equation 


a 4 e^t. The first term can 


1 


3.6.37 can be broken into two terms: b a e! and c ( 5; 


be incorporated into the c a e * term. Thus, the general solution is 


x—a ({)ette (o) em e (3.6.38) 
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e Example 3.6.3 


Let us solve the system of linear differential equations: 


x, = 2x; — 312, (3.6.39) 
and 
xy = 3x1 + 2x9; (3.6.40) 
or in matrix form, 
1 2 —3 = X1 
x =, 9 )x Re. (3.6.41) 
Assuming the solution x = xoe^', 
2 T ? nd xo = 0. (3.6.42) 
For nontrivial solutions, 
| : 3 ; 2 | = (2-2)? +9 =0, (3.6.43) 


a 


b 


and A = 2+ 3i. It x = ( ) then 6 = -ai if A= 23i and b = ai if A = 2 — 3i. Thus, 


the general solution is 


x= ( 2 etr + co (1) poc (3.6.44) 


where c, and c» are arbitrary complex constants. Using Euler relationships, we can rewrite 


Equation 3.6.44 as 
" cos(3t) | sin(3t) | 5 
X — c3 E | e” +e cos(3t) e”, (3.6.45) 


where c3 = c1 + cg and c4 = i(c — c2). 
Problems 
Find the general solution of the following sets of ordinary differential equations using the 


matrix technique. You may find the eigenvalues and eigenvectors either by hand or use 
MATLAB. 


1. z, = £1 + 222 Uy = 24, + T2 
2. £} = £1 — 429 Uy = 3x1 — 6x2 
3. d^ = £1 + $2 Uy = 4m, + T2 

4. x^, = £1 + 529 Ly = —2x4 — 6x5 
5. a = -3z — 2x23 Uy = 2a, + 329. 
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6. v = —3z, — 2x5 Ly = 2x4 + X2 

T. £} = £1 — T2 Ly = T1 + 322 

8. x} = 3x1 + 22» Uy = —2x4— T2 

9. x} = —2z, — 1322 Uy = £1 + 4x9 

10. x} = 3x1 — 2x3 Uy = 5x4 — 329 

11. x} = 4x1 — 2x2 vy = 25x1 — 10z2 

12. x} = —3x1 — 4r» Ly = 2x4 + T2 

13. z/ = 3x1 + 423 Uy = —2x4— T2 

14. x| + 5z1 + 25 312 = 0 2x + z1 x54 242 =0 

15. z, — z1 + zh — 2x2 = 0 xi — 5x1 + 225 — Tro = 0 

16. z' = z1 — 2x2 ry = 0 z3 = —5z4 + Tz3. 
17. x, = ar Ly = T1 2x3 £3 = T3. 

18. xv = 321 — 2x3 vy = —T1 + 222 + T3 xv, = 4x1 — 373 
19. z' = 321 — v3 Uy = —2ax4 + 2424+ T3 xv = 8x1 — 323 


3.7 MATRIX EXPONENTIAL 


In the previous section we solved initial-value problems involving systems of linear 
ordinary differential equations via the eigenvalue problem. Here we introduce an alternative 
method based on the matriz exponential, defined by 


e^! = T+ Atc dA? +--+ LAUS. (3.7.1) 
Clearly 
d 
e = e^0 =], and qe) = Ae“, (3.7.2) 


Therefore, using the matrix exponential function, the solution to the system of homogeneous 
linear first-order differential equations with constant coefficients 


x’ = Ax, x(0) = Xo, (3.7.3) 


Atxo. 


is x(t) =e 
The question now arises as to how to compute this matrix exponential. There are 
several methods. For example, from the concept of diagonalization of a matrix (see Example 


3.6.4) we can write A = PDP™~', where P are the eigenvectors of A. Then, 


cp. & P =e 
esy RE s MPPI- (> — | P-1 = Pe? PH, (3.7.4) 
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where 
e^ 0 0 
0 eg ... 0 
pem TE ue u.s (3.7.5) 
0 0 e 


Because many software packages contain routines for finding eigenvalues and eigenvectors, 
Equation 3.7.4 provides a convenient method for computing e^. In the case of MATLAB, 
we just have to invoke the intrinsic function expm(-). 

In this section we focus on a recently developed method by Liz,’ who improved a 
method constructed by Leonard.® The advantage of this method is that it uses techniques 
that we have already introduced. We will first state the result and then illustrate its use. 

'The main result of Liz's analysis is: 


Theorem: Let A be a constant n x n matrix with characteristic polynomial p(A) = A” + 
Cn 1A771 E eA co. Then 


e^t = q(t) + a(t) A +- + zs (t)A771, (3.7.6) 
where 
xı(t) qi(t) 
L(t) a | vat) 
= B; 2 ds (3.7.7) 
Sut) Yn(t) 
git) git) of PQ) 
p- | 2 Oo oP PO ane 
galt) eh se oD) 


and S = {y1(t), pa(t),..-, en(t)} being a fundamental system of solutions for the homoge- 
neous linear differential equations whose characteristic equation is the characteristic equa- 
tion of A, p(A) = 0. The proof is given in Liz’s paper. Note that for this technique to work, 
xı(0) = 1 and z2(0) = z3(0) =--- = 2,(0) = 0. 


e Example 3.7.1 


Let us illustrate this method of computing the matrix exponential by solving 


rz! —2x—gy-z, (3.7.9) 
y = 3y- z, (3.7.10) 

and 
z! = 2x +y + 3z. (3.7.11) 


T Liz, E., 1998: A note on the matrix exponential. SIAM Rev., 40, 700-702. 


8 Leonard, I. E., 1996: The matrix exponential. SIAM Rev., 38, 507-512. 
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The solution to this system of equations is x = e^'xo, where 
2 —1 1 x(t) 
A=|0 3 -1 and x= | y(t) (3.7.12) 
2 1 3 z(t) 


The vector xo is the value of x(t) at t = 0. 
Our first task is to compute the characteristic polynomial p(A) = 0. This is simply 


A-2 1 -1 
I—Al=| 0 A-3 1 |[-(A-2Y(A-4)-0. (3.7.13) 
2 1 A-3 


Consequently, À = 2 twice and A = 4, and the fundamental solutions are S = (6€?! , te’, e*t V, 
Therefore, 


ett 4e4t 16e4t 
Bie | e” 2e?t 4e% ; (3.7.14) 
te™ e?! + 2te?! 4e% + Ate?t 
and 
6 —4 6 1 4 16 -1 0 -4 
&£=|-2 8 26],.Bg5| Y 2 4|, B=ļ|-1 1 3 |. (3.7.15) 
1 1 
10 4 10 01 4 qi Gig, d» 
The inverse Bg ! can be found using either Gaussian elimination or MATLAB. 
To find zi(t), v2(t) and x3(t), we have from Equation 3.7.7 that 
x(t) -1 0 -4 e*t ett — 4te”% 
z(t) | 2| -1 1 8 e% | = e?t — eft + 3te?t ; (3.7.16) 
x3(t) 1 -i -i te?t jet E ie = ste" 


e” — Ste. — (3.717) 


Note that z1(0) = 1 while x2(0) = x3(0) = 0. 
Finally, we have that 


Y. 0730 Pooh, d 6 -4 6 
e-gu(t|0o10]|-cz(0[0o 3 -1|-z(2)|-2 8 -6]|. (3.718) 
001 2 1 3 10 4 10 


Substituting for zı (t), z2(t) and x3(t) and simplifying, we finally obtain 


: ett 4 gt — tet bet elt — e2t 
e^t = 2 e — ett + 2te” 2(t+1)je e-e |; (3.7.19) 
EINE OE 21e2t et p e?! 
or 
x(t) = (4e** + 1e?* — te") x1 (0) — te?*xa(0) + (1e** — de") x3(0), (3.7.20) 


zalt) = (&e?* — Le** + te") x1 (0) + (t + 1)e?'25(0) + (3e — de*) x3(0), (3.7.21) 
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and 


e Example 3.7.2 


'The matrix exponential can also be used to solve systems of first-order, nonhomoge- 
neous linear ordinary differential equations. To illustrate this, consider the following system 
of linear ordinary differential equations: 


z'-—x—4y- e”, (3.7.23) 
and 
y =x+5y+t. (3.7.24) 
We can rewrite this system as 
x’ = Ax +b, (3.7.25) 
where (i) 
1 —4 € c(t 
a-(i uw) s-(T)o ma xe (2). era 
We leave as an exercise the computation of the matrix exponential and find that 
3t 3t 3t 
At [€ — 2te —Ate 
a ( test PM e) ; (3.7.27) 


Clearly the homogeneous solution is xy (t) = e^*C, where C is the arbitrary constant 
that is determined by the initial condition. But how do we find the particular solution, 
Xp(t)? Let x,(t) = e^ty(t). Then 


x, (t) = Ae“*y(t) + e^*y'(t), (3.7.28) 
Or 
x, (t) = Ax,(t) + e^'y'(t). (3.7.29) 
Therefore, 
ety’ (t) = b(t), or y(t) = e-^'b(t), (3.7.30) 


since (e^) * = e^ ^, Integrating both sides of Equation 3.7.29 and multiplying through by 
e^t, we find that 


t t 
x,(t) = | eA 7 p(s) ds = f e^*b(t — s) ds. (3.7.31) 
0 0 
Returning to our original problem, 
t t 3s _ 3s _ 3s 2(t—s) 
As O u € 2se Ase € 
ni e^*b(t — s) ds = f ( 338 esa 29 ( NY ) ds (3.7.32) 
t 2t ( 5s s 3s 
= e” (e* — 2se*) — 4s(t — s)e 
i i E + (t — s)e35 + 2s(t — s)e?5 € (82599) 
» e 3e?t 22 test st = 
= (3.7.34) 


28 -3t | ,2t |, 11,,3t 1, , 1 
27€ re T gte gt ij 
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The final answer consists of the homogeneous solution plus the particular solution. 
Problems 


Find e^* for the following matrices A: 


5 —3 1 3 3 5 
L4-(1 1) 2.4=(5 i) A-($ 3) 


110 2 3 4 120 
4. A—-[0 1 1 5. A={|0 2 3 6 A={0 1 2 
0 0 1 0 0 2 0 0 1 


For each of the following A’s and b’s, use the matrix exponential to find the general solution 
for the system of first-order, linear ordinary differential equations x’ = Ax + b: 


name seine) 


[mn 
© 
c 
Il 
Q a 
m 
c 
D 
Il 
l 
nÓ 
w 
A 
c 
I 
en 


m 
© 
N 
(c 
= 


m 
wo 
D 
ll 
Lo AETR ATN 
or 
m 
= = 
c 
ll 
= 
Eus 
N 
A 
: & t 
DdD 
ll 
i "s P umm 
Cor 
| 
ME 
or 
c 
| 
e 
SE 


Further Readings 


Bronson, R., and G. B. Costa, 2007: Linear Algebra: Am Introduction. Academic Press, 
520 pp. Provides a step-by-step explanation of linear algebra. 


Davis, H. T., and K. T. Thomson, 2000: Linear Algebra and Linear Operators in Engi- 
neering with Applications in Mathematica. Academic Press, 547 pp. Advanced textbook 
designed for first-year graduate students in the physical sciences and engineering. 


Hoffman, J., 2001: Numerical Methods for Engineers and Scientists. Mc-Graw Hill, 823 pp. 
A first course in numerical methods that is both lucid and in depth. 


Munakata, T., 1979: Matrices and Linear Programming with Applications. Holden-Day, 
469 pp. Provides the basic concepts with clarity. 
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Noble, B., and J. W. Daniel, 1977: Applied Linear Algebra. Prentice Hall, 494 pp. Excellent 
conceptual explanations with well-motivated proofs. 


Strang, G., 2009: Linear Algebra and Its Applications. Academic Press, 584 pp. A good 
supplement to a formal text that provides intuitive understanding. 


Wilkinson, J. H., 1988: The Algebraic Eigenvalue Problem. Clarendon Press, 662 pp. The 
classic source book on the eigenvalue problem 


Chapter 4 


Vector Calculus 


Physicists invented vectors and vector operations to facilitate their mathematical ex- 
pression of such diverse topics as mechanics and electromagnetism. In this chapter we focus 
on multivariable differentiations and integrations of vector fields, such as the velocity of a 
fluid, where the vector field is solely a function of its position. 


4.1 REVIEW 


The physical sciences and engineering abound with vectors and scalars. Scalars are 
physical quantities that only possess magnitude. Examples include mass, temperature, 
density, and pressure. Vectors are physical quantities that possess both magnitude and 
direction. Examples include velocity, acceleration, and force. We shall denote vectors by 
boldfaced letters. 

Two vectors are equal if they have the same magnitude and direction. From the limitless 
number of possible vectors, two special cases are the zero vector 0, which has no magnitude 
and unspecified direction, and the unit vector, which has unit magnitude. 

The most convenient method for expressing a vector analytically is in terms of its 
components. A vector a in three-dimensional real space is any order triplet of real numbers 
(components) a1, a2, and aa such that a = aii + a»j + ask, where aii, a2j, and agk are 
vectors that lie along the coordinate axes and have their origin at a common initial point. 
The magnitude, length, or norm of a vector a, |a|, equals \/az + a3 +. a2. A particularly 
important vector is the position vector, defined by r = xi + yj + zk. 

As in the case of scalars, certain arithmetic rules hold. Addition and subtraction are 
very similar to their scalar counterparts: 


a+b= (a1 + bi)i + (az + b2)j + (aa + bs )k, (4.1.1) 
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and 


a—b- (a1 bi)i f (a2 be)j | (aa b3)k. (4.1.2) 


In contrast to its scalar counterpart, there are two types of multiplication. The dot 
product is defined as 


a: b= Ja||b| cos(0) = a1b1 + a202 + agbs, (4.1.3) 


where 0 is the angle between the vector such that 0 < 0 < m. The dot product yields a 
scalar answer. A particularly important case is a - b = 0 with |a| 4 0, and |b| 4 0. In this 
case the vectors are orthogonal (perpendicular) to each other. 

The other form of multiplication is the cross product, which is defined by a x b = 
|a||b| sin(0)n, where 0 is the angle between the vectors such that 0 € 0 < v, and n is a unit 
vector perpendicular to the plane of a and b, with the direction given by the right-hand 
rule. A convenient method for computing the cross product from the scalar components of 
a and b is 


i j k 
ag a3 a, a3 a, a2 
b= = k. 4.1.4 
ae E M cU, TM by bs b; b (4.1.4) 
bj b2 bs 


Two nonzero vectors a and b are parallel if and only if a x b = 0. 

Most of the vectors that we will use are vector-valued functions. These functions are 
vectors that vary either with a single parametric variable t or multiple variables, say x, y, 
and z. 

'The most commonly encountered example of a vector-valued function that varies with 
a single independent variable involves the trajectory of particles. If a space curve is param- 
eterized by the equations r — f(t), y — g(t), and z — h(t) with a € t € b, the position 
vector r(t) = f(t)i+ g(t)j + h(t)k gives the location of a point P as it moves from its initial 
position to its final position. Furthermore, because the increment quotient Ar/At is in the 
direction of a secant line, then the limit of this quotient as At — 0, r'(t) gives the tangent 
(tangent vector) to the curve at P. 


e Example 4.1.1: Foucault pendulum 


One of the great experiments of mid-nineteenth-century physics was the demonstration 
by J. B. L. Foucault (1819-1868) in 1851 of the earth's rotation by designing a (spherical) 
pendulum, supported by a long wire, that essentially swings in an nonaccelerating coor- 
dinate system. This problem demonstrates many of the fundamental concepts of vector 
calculus. 

The total force! acting on the bob of the pendulum is F = T + mG, where T is 
the tension in the pendulum and G is the gravitational attraction per unit mass. Using 
Newton's second law, 

d?r T 


z5 =—+G, (4.1.5) 


inertial m 


where r is the position vector from a fixed point in an inertial coordinate system to the bob. 
This system is inconvenient because we live on a rotating coordinate system. Employing 


1 See Broxmeyer, C., 1960: Foucault pendulum effect in a Schuler-tuned system. J. Aerosp. Sci., 27, 
343-347. 
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the conventional geographic coordinate system,? Equation 4.1.5 becomes 


d 
E pisc dE 


T 
di? yt (Qxr)=— +G, (4.1.6) 


where Q is the angular rotation vector of the earth and r now denotes a position vector in 
the rotating reference system with its origin at the center of the earth and terminal point at 
the bob. If we define the gravity vector g = G — Q x (Q x r), then the dynamical equation 


1S 
dr dr T 
-20 = 4.1.7 
dt ge m S (ELT) 


where the second term on the left side of Equation 4.1.7 is called the Coriolis force. 

Because the equation is linear, let us break the position vector r into two separate 
vectors: ro and rı, where r = ro + rı. The vector rọ extends from the center of the earth 
to the pendulum’s point of support, and rı extends from the support point to the bob. 
Because ro is a constant in the geographic system, 


dr, LINQ x dri = T 


= +g. 4.1.8 
di? a ome (4:8) 


If the length of the pendulum is L, then for small oscillations rı + xi + yj + Lk and 
the equations of motion are 


dx dy Ty, 
— + 20 si — = — 4.1.9 
dg + 20 sin(A) Ti m’ ( ) 
dy : dr Ty 
and d i 
7107 5 (0 y Z -g= Z, (4.1.11) 
dt m 


where A denotes the latitude of the point and Q is the rotation rate of the earth. The 
relationships between the components of tension are T, = zT;/L, and T} = yT;/L. From 
Equation 4.1.11, 

Tz dy 

— +g = 2Qcos(A)— z 0. (4.1.12) 

m dt 


Substituting the definitions of Ty, Ty, and Equation 4.1.12 into Equation 4.1.9 and Equation 
4.1.10, 


dy g dy 
sim 20 si e 4.1.13 
aa +t Tt + 20 sin(A) di 0, ( ) 
and 2 4 
Yg : To 
dg * py 20 sin(A) m 0. (4.1.14) 


'The approximate solution to these coupled differential equations is 
x(t) = Ag cos[Q sin(A)t] sin( g/L t) l (4.1.15) 


and 
y(t) = Ao sin{Q sin(A)t] sin( g/L t) l (4.1.16) 


2 For the derivation, see Marion, J. B., 1965: Classical Dynamics of Particles and Systems. Academic 
Press, Sections 12.2-12.3. 
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Figure 4.1.1: For a two-dimensional field T(x, y), the gradient is a vector that is perpendicular to the 
isotherms T(x, y) = constant and points in the direction of most rapidly increasing temperatures. 


if Q? < g/L. Thus, we have a pendulum that swings with an angular frequency \/g/L. 
However, depending upon the latitude A, the direction in which the pendulum swings 
changes counterclockwise with time, completing a full cycle in 2z/[O sin(A)]. This result is 
most clearly seen when À = 7/2 and we are at the North Pole. There, the earth is turning 
underneath the pendulum. If initially we set the pendulum swinging along the 0? longitude, 
the pendulum will shift with time to longitudes east of the Greenwich median. Eventually, 
after 24 hours, the process repeats itself. 


Consider now vector-valued functions that vary with several variables. A vector func- 
tion of position assigns a vector value for every value of x, y, and z within some domain. 
Examples include the velocity field of a fluid at a given instant: 


v = u(z,y, z)i+ (a, y, z)j + w(o, y, z)k. (4.1.17) 


Another example arises in electromagnetism where electric and magnetic fields often vary 
as a function of the space coordinates. For us, however, probably the most useful example 
involves the vector differential operator, del or nabla, 


T= 2i + 5j + ox (4.1.18) 
which we apply to the multivariable differentiable scalar function F(x, y,z) to give the 
gradient VF. 

An important geometric interpretation of the gradient—one which we shall use fre- 
quently—is the fact that V f is perpendicular (normal) to the level surface at a given point 
P. To prove this, let the equation F(x,y,z) = c describe a three-dimensional surface. If 
the differentiable functions x — f(t), y — g(t), and z — h(t) are the parametric equations 
of a curve on the surface, then the derivative of F[f(t), g(t), h(t)] = c is 


OF dz OF dy OF dz 
H = 4.1. 
Ox dt Oy dt T Oz dt ? et?) 


or 
VF -r' =0. (4.1.20) 


When r’ z 0, the vector VF is orthogonal to the tangent vector. Because our argument 
holds for any differentiable curve that passes through the arbitrary point (x,y,z), then VF 
is normal to the level surface at that point. 
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Figure 4.1.1 gives a common application of the gradient. Consider a two-dimensional 
temperature field T(x, y). The level curves T(x, y) = constant are lines that connect points 
where the temperature is the same (isotherms). The gradient in this case, VT, is a vector 
that is perpendicular or normal to these isotherms and points in the direction of most 
rapidly increasing temperature. 


e Example 4.1.2 


Let us find the gradient of the function f(x,y,z) = z?2? sin(4y). 


Using the definition of gradient, 


_ O[z?z? sin(4y)], O[x?z? sin(4y)]. O[z? z? sin(4y)] 
Vf = c i4 By j4 k (4.1.21) 
= 2x? sin(4y)i + 4a?z? cos(4y)j + 2x?z sin(4y)k. (4.1.22) 


e Example 4.1.3 


Let us find the unit normal to the unit sphere at any arbitrary point (x,y,z). 
The surface of a unit sphere is defined by the equation f(x,y,z) = x? + y? +27 — 1. 
'Therefore, the normal is given by the gradient 


N = Vf = 2zi + 2yj + 2zk, (4.1.23) 


and the unit normal 


V 23i + 2yj + 2zk 
CON MC DNI MEL LEE FRU ES (4.1.24) 


(VEL a2 + A? + 422 
y 


because z? + y? +27 — 1. 


e Example 4.1.4 


In Figure 4.1.2, MATLAB has been used to illustrate the unit normal of the surface 
z—4-—z?-y?. Here f(z,y,z) = z +x? +y? = 4 so that Vf = 2zi + 2yj +k. The 
corresponding script is: 
clear % clear variables 
clf ^ clear figures 
[x,y] = meshgrid(-2:0.5:2); % create the grid 
z=4- x.°2 - y.^2; % compute surface within domain 
^4 compute the gradient of f(x,y,z) =z+x°2+y2=4 
% the x, y, and z components are u, v, and w 
u = 2*x; v = 2*y; w= 1; 
^4 find magnitude of gradient at each point 
magnitude = sqrt(u.*u + v.*v + w.*w); 
^4 compute unit gradient vector 
u = u./magnitude; v = v./magnitude; w = w./magnitude; 
mesh(x,y,z) ^ plot the surface 
axis square 
xlabel(’x’); ylabel(’y’) 
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Figure 4.1.2: MATLAB plot of the function z = 4 — x? — y?. The arrows give the unit normal to this 
surface. 


hold on 
^4 plot the unit gradient vector 
quiver3(x,y,z,u,v,w,0) 

This figure clearly shows that gradient gives a vector which is perpendicular to the 
surface. 


A popular method for visualizing a vector field F is to draw space curves that are 
tangent to the vector field at each x,y,z. In fluid mechanics these lines are called stream- 
lines, while in physics they are generally called lines of force or flux lines for an electric, 
magnetic, or gravitational field. For a fluid with a velocity field that does not vary with 
time, the streamlines give the paths along which small parcels of the fluid move. 

To find the streamlines of a given vector field F with components P(x,y, z), Q(z, y, z), 
and R(r,y,z), we assume that we can parameterize the streamlines in the form r(t) = 
x(t)i+ y(t)j + z(t)k. Then the tangent line is r'(t) = x’ (t)i+ y'(t)j + z'(t)k. Because the 
streamline must be parallel to the vector field at any t, r'(t) = AF, or 


dx dy dz 
eee += = 4.1.2 
HOP ew, gane) and = = AR(z,y, 2), (4.1.25) 
or 
dx dy dz 


P(x,y, z) i Q(x, y, z) = R(z,y,z) (4.1.26) 


'The solution of this system of differential equations yields the streamlines. 


e Example 4.1.5 


Let us find the streamlines for the vector field F = sec(x)i — cot(y)j + k that passes 
through the point (7/4, 7,1). In this particular example, F represents a measured or com- 
puted fluid's velocity at a particular instant. 

From Equation 4.1.26, 


= ==, (4.1.27) 
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This yields two differential equations: 


cos(x) dz = -5 dy, and dz = A— dy. (4.1.28) 
Integrating these equations gives 
sin(x) = ln | cos(y)| Feci, and z=In|cos(y)| + c2. (4.1.29) 
Substituting for the given point, we finally have that 
sin(x) = ln | cos(y)| + V2/2, and z=In|cos(y)| + 1. (4.1.30) 


e Example 4.1.6 


Let us find the streamlines for the vector field F = sin(z)j + e"k that passes through 
the point (2, 0,0). 
From Equation 4.1.26, 


tos (4.1.31) 
This yields two differential equations: 
dz = 0, and sin(z) dz = e" dy. (4.1.32) 
Integrating these equations gives 
zc, and e” = — cos(z) + c2. (4.1.33) 
Substituting for the given point, we finally have that 
xz —2, and e" — 2 — cos(z). (4.1.34) 


Note that Equation 4.1.34 only applies for a certain strip in the yz-plane. 
Problems 


Given the following vectors a and b, verify that a- (a x b) = 0, and b- (a x b) = 0: 


l.a=4i-2j+5k, b=3i+j—k 2.a=i-3j+k, b=2i+4k 
3.a=i+j+k, b=—5i+2j+3k 4.a=8i+j—6k, b=i-2j+10k 
5. a=2i+7j—4k, b=i+j—k. 6. a= —4i— 2j +3k, b= 6i— 2j + 4k. 


7. Prove a x (b x c) = (a: c)b — (a - b)c. 
8. Prove a x (bx c) - x (c xa) +c x (ax b) = 0. 


Find the gradient of the following functions: 
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9. f(2,y,2) = ay? [2 10. f(m,y,z) =aycos(yz) — 11. f(a,y,2) =In(e? +y? + 2) 
12. f(a, y, z) = a?y?(2z + 1)? 13. f(x,y,z) 22x — y? +2? 14. f(x,y,z) = cosh(x — y + 22). 


Use MATLAB to illustrate the following surfaces as well as the unit normal. 


15.z=3 16. z? +y? = 4 17. z = £? +y? 18. z = yx? + y? 
19.z=y 20.¢+y+2z=1 Di ium 22. z2 = y? — y?. 


Find the streamlines for the following vector fields that pass through the specified point: 


23. F =i+j+k; (0,1,1) 24. F = 2i — y?j + zk; (1,1,1) 
25. F = 327i — y^] + z?k; (2, 1,3) 26. F = x7i + y?j — z°k; (1,1,1) 
27. F = (1/x)i + e"j — k; (2,0, 4) 28. F = cos(y)i + sin(z)j; (7/2, 0, —4). 


29. Solve the differential equations, Equation 4.1.13 and Equation 4.1.14, with the initial 
conditions z(0) = y(0) = y' (0) = 0, and z'(0) = Ag /g/L assuming that 0? « g/L. 


30. If a fluid is bounded by a fixed surface f(x,y,z) = c, show that the fluid must satisfy 
the boundary condition v - V f = 0, where v is the velocity of the fluid. 


31. A sphere of radius a is moving in a fluid with the constant velocity u. Show that the 
fluid satisfies the boundary condition (v — u) - (r — ut) = 0 at the surface of the sphere, if 
the center of the sphere coincides with the origin at t — 0 and v denotes the velocity of the 
fluid. 


4.2 DIVERGENCE AND CURL 


Consider a vector field v defined in some region of three-dimensional space. The func- 
tion v(r) can be resolved into components along the i, j, and k directions, or 


v(r) = u(z, y, z)i + v(x, y, z)) + w(x, y, z)k. (4.2.1) 
If v is a fluid's velocity field, then we can compute the flow rate through a small (differential) 
rectangular box defined by increments (Az, Ay, Az) centered at the point (x,y,z). See 
Figure 4.2.1. The flow out from the box through the face with the outwardly pointing 
normal n = —j is 

v- (—j) = —v(z,y — Ay/2, z) Ax Az, (4.2.2) 

and the flow through the face with the outwardly pointing normal n — j is 
v-j=v(a,y + Ay/2, z) Az Az. (4.2.3) 


'The net flow through the two faces is 


[v(z, y + Ay/2, z) — v(z, y — Ay/2, z)) Az Az & vy(m, y, z) Am Ay Az. (4.2.4) 
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Figure 4.2.1: Divergence of a vector function v(z, y, z). 


A similar analysis of the other faces and combination of the results gives the approximate 
total flow from the box as 


[us (x, y, z) T vy(z, y, z) t Wz (z, Y, z))AzAyAzs. (4.2.5) 


Dividing by the volume AzAyAz and taking the limit as the dimensions of the box tend 
to zero yield uz + v, + wz as the flow out from (x, y, z) per unit volume per unit time. This 
scalar quantity is called the divergence of the vector v: 


aif Oe Ə, ð eos " 
div(v) =V -v= (zi- ay) t 5x) : (ui + vj + wk) = uz + vy + wz. (4.2.6) 


Thus, if the divergence is positive, either the fluid is expanding and its density at the point 
is falling with time, or the point is a source at which fluid is entering the field. When the 
divergence is negative, either the fluid is contracting and its density is rising at the point, 
or the point is a negative source or sink at which fluid is leaving the field. 

If the divergence of a vector field is zero everywhere within a domain, then the flux 
entering any element of space exactly balances the flux leaving it and the vector field is 
called nondivergent or solenoidal (from a Greek word meaning a tube). For a fluid, if there 
are no sources or sinks, then its density cannot change. 

Some useful properties of the divergence operator are 


V-(F+G)=V-F+V-G, (4.2.7) 
V- (pF) =9V-F+F-Vo (4.2.8) 

and 
Vp = V: Ve = Qs + Pyy + zs (4.2.9) 


Equation 4.2.9 is very important in physics and is given the special name of the Laplacian.? 


e Example 4.2.1 


If F = z?zi — 23? 22j + zy? zk, compute the divergence of F. 


3 Some mathematicians write A instead of V?. 
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e < o —— e t P4 e A 
—- t —e BY 
no divergence divergence no divergence divergence 


no curl no curl curl and curl 


Figure 4.2.2: Examples of vector fields with and without divergence and curl. 


az?) 4 (-29? 2?) 4 2. (zy^z) = 2zz  6y?z^ --xy?. (4.2.10) 


e Example 4.2.2 


If r = zi + yj + zk, show that r/|r|? is nondivergent. 


v.[ © \- Ó x a o y 
Ir?) Oz | (22 + y? + 22)3/2 dy | (12 + y? + 22)372 


ð z 
| Oz [s +y2 + — (4.2.11) 


= 3 32? + 3y? + 32? = 
~ (a2 +y? + 22)8/2 (a? + y? + 22)5/2 — 0. (4.2.12) 


Another important vector function involving the vector field v is the curl of v, written 
curl(v) or rot(v) in some older textbooks. In fluid flow problems it is proportional to the 
instantaneous angular velocity of a fluid element. In rectangular coordinates, 


curl(v) = V x v = (wy — vj; + (uz — wr)j + (Vs — uy)k, (4.2.13) 


where v = ui + vj + wk as before. However, it is best remembered in the mnemonic form: 


VxF= = (wy — vz)i+ (uz — We)j + (ve — Uy)k. (4.2.14) 


ge ge - 
sse. 
8 gez 


If the curl of a vector field is zero everywhere within a region, then the field is trrotational. 

Figure 4.2.2 illustrates graphically some vector fields that do and do not possess diver- 
gence and curl. Let the vectors that are illustrated represent the motion of fluid particles. 
In the case of divergence only, fluid is streaming from the point at which the density is 
falling. Alternatively, the point could be a source. In the case where there is only curl, 
the fluid rotates about the point and the fluid is incompressible. Finally, the point that 
possesses both divergence and curl is a compressible fluid with rotation. 

Some useful computational formulas exist for both the divergence and curl operations: 


Vx(F+G)=VxF+VxG, (4.2.15) 
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V x Ve — 0, (4.2.16) 

V-VxF=0, (4.2.17) 

V x (pF) = 9V x F+V¢~x F, (4.2.18) 
V(F-G)=(F-V)G+(G-V)F+Fx (V x G)+Gx (V x EF), (4.2.19) 

V x (Fx G)=(G-V)F-(F-V)G+F(V-G)-G(V-F), (4.2.20) 
Vx(VxF)=V(V-F)-(V-V)F, (4.2.21) 

i V- (Fx G)=G-VxF-F-VxG. (4.2.22) 


In this book, the operation VF is undefined. 
e Example 4.2.3 


If F = zzi — 2x7 yzj + 2yz4k, compute the curl of F and verify that V. V x F = 0. 
From the definition of curl, 


ð ə [7] 
VxF-|Z 5 E (4.2.23) 


Tz 

= [8; Quz*) - & (-22y2) i- [£ v2) - £ (2) 
fe) 
Ox 


+ [£ (22295) - 2 (25) k (4.2.24) 
= (224 + 2x7y)i — (0 — 3z22)j + (-4xyz — 0)k (4.2.25) 
= (224 + 22?y)i + 322?j — Axyzk. (4.2.26) 


From the definition of divergence and Equation 4.2.26, 


o o o 
V-VxF= 3,07 + 2a7y) + o, 927) 5; Aryz) = 4ry +0 — 4xy — 0. (4.2.27) 


e Example 4.2.4: Potential flow theory 


One of the topics in most elementary fluid mechanics courses is the study of irrotational 
and nondivergent fluid flows. Because the fluid is irrotational, the velocity vector field v 
satisfies V x v = 0. From Equation 4.2.16 we can introduce a potential y such that 
v = Vy. Because the flow field is nondivergent, V. v = V2y = 0. Thus, the fluid flow 
can be completely described in terms of solutions to Laplace's equation. This area of fluid 
mechanics is called potential flow theory. 


Problems 
Compute V. F, Vx E, V. (V x F), and V(V - F), for the following vector fields: 


1. F = z?zi + yz?j + zy?k 2. F = Az?y^i + (2x + 2yz)j + (3z + y?)k 
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3. F = (x — y)7it+ e Vj + zze?"k 4. F = 3zyi + 272?j + V?k 

5. F = 5yzi + z?zj + 32°k 6. F = 33i + (23 y? — zy)j — (23 yz — 2z)k 
7. F = ze "ic yz?jc3e ^k 8. F = yIn(z)i + (2 — 3yz)j + zyzk 

9. F = zyzi- a?yze^j + xye^k 10. F = (zy? — z*)i + 4x*y?zj — y*z?k 
11. F = zy?i + zyz?j + zy cos(z)k 12. F = zy?i + zyz?j + zy sin(z)k 

13. F = zy?i + zyzj + zy cos(z)k 14. F = sinh(z)i + cosh(y)j — xyzk 


15. (a) Assuming continuity of all partial derivatives, show that 
Vx(VxF)-2V(V.F)- V?F. 
(b) Using F = 3xyi + 4yzj + 2zzk, verify the results in part (a). 


16. If E = E(z, y, z,t) and B = B(z,y, z,t) represent the electric and magnetic fields in a 
vacuum, Maxwell’s field equations are: 


V-E=0, Vinee. 
c Ot 
V.B-0, ven 
c Ot 


where c is the speed of light. Using the results from Problem 15, show that E and B satisfy 


1 E 1 8B 
25 2p _ 
VE- 5] and VD =a ap: 


17. If f and g are continuously differentiable scalar fields, show that V f x Vg is solenoidal. 
Hint: Show that Vf x Vg = V x (fVg). 


18. An inviscid (frictionless) fluid in equilibrium obeys the relationship Vp — pF, where 
p denotes the density of the fluid, p denotes the pressure, and F denotes the body forces 
(such as gravity). Show that F - V x F = 0. 


4.3 LINE INTEGRALS 


Line integrals are ubiquitous in physics. In mechanics they are used to compute work. 
In electricity and magnetism, they provide simple methods for computing the electric and 
magnetic fields for simple geometries. 

The line integral most frequently encountered is an oriented one in which the path C 
is directed and the integrand is the dot product between the vector function F(r) and the 
tangent of the path dr. It is usually written in the economical form 


[Pa [Pon + QU 2) dy + Rs 2) dz, (43.1) 
C C 
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1 0 


oo 


Figure 4.3.1: Diagram for the line integration in Example 4.3.1. 


where F = P(z,y, z)i+ Q(z,y, z)j + R(z, y, z)k. If the starting and terminal points are the 
same so that the contour is closed, then this closed contour integral will be denoted by fo- 
In the following examples we show how to evaluate the line integrals along various types of 
curves. 


e Example 4.3.1 


If F = (3x? + 6y)i — 14yzj + 20z^k, let us evaluate the line integral fj, F - dr along 
the parametric curves x(t) = t, y(t) = t?, and z(t) = t? from the point (0,0,0) to (1,1,1). 
Using the MATLAB commands: 
>> clear 
>> t = 0:0.02:1 
>> stem3(t,t.^2,t.^3); xlabel(’x’,’Fontsize’ ,20); 

ylabel(’y’,’Fontsize’,20); zlabel(’z’,’Fontsize’ ,20); 
we illustrate these parametric curves in Figure 4.3.1. 

We begin by finding the values of t, which give the corresponding endpoints. A quick 
check shows that t = 0 gives (0,0,0) while t = 1 yields (1,1,1). It should be noted that 
the same value of t must give the correct coordinates in each direction. Failure to do so 
suggests an error in the parameterization. Therefore, 


^ F.dr = n + 602) dt — 14 (t°) d(t?) + 20t(09)?q(t9) (4.3.2) 
C 0 


1 
E | 9t? dt — 281° dt + 60? dt = (306 — 4t" + 6t1°) |, = 5. (4.3.3) 
0 


e Example 4.3.2 


Let us redo the previous example with a contour that consists of three “dog legs,” 
namely straight lines from (0,0,0) to (1,0,0), from (1,0,0) to (1, 1,0), and from (1,1,0) to 
(1, 1, 1). See Figure 4.3.2. 
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(1,0,0) 
x 


Figure 4.3.2: Diagram for the line integration in Example 4.3.2. 


In this particular problem we break the integration down into integrals along each of 


the legs: 
[Ea] F-dr+ | Foart | F - dr. (4.3.4) 
C Cy C2 Cs 


For C4, y = z = dy = dz = 0, and 


1 1 
ni Fede = f (32? 6-0)dz - 14-0-0:0 207.090 | 3a?dr —1. (4.3.5) 
Ci 0 0 
For C5, x = 1 and z = dx = dz = 0, so that 
1 
f Pedr = f (3-1? + 6y)-0—1dy-0- dy +20-1-0?-0=0. (4.3.6) 
C2 0 
For C3, x = y = 1 and dx = dy = 0, so that 
1 1 
D Far-[ (3-19+6-1)-0-14-1-2-0420-1-2de= | 2027 dz = Æ. (4.3.7) 
C3 0 


0 


Therefore, 


| F-dr = 3. (4.3.8) 
C 


e Example 4.3.3 


For our third calculation, we redo the first example where the contour is a straight line. 
The parameterization in this case is x = y= z = t with 0 € t € 1. See Figure 4.3.3. Then, 


f F- dr = n + 6t) dt — 14(t)(t) dt + 20t(t)? dt (4.3.9) 
C 0 


1 
= n (3t? + 6t — 14? + 2005) dt = 2. (4.3.10) 
0 
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X 


Figure 4.3.3: Diagram for the line integration in Example 4.3.3. 


An interesting aspect of these three examples is that, although we used a common 
vector field and moved from (0, 0,0) to (1, 1, 1) in each case, we obtained a different answer 
in each case. Thus, for this vector field, the line integral is path dependent. This is generally 
true. In the next section we will meet conservative vector fields where the results will be 
path independent. 


e Example 4.3.4 
If F = (x? + y?)i — 2ayj + zk, let us evaluate fj F -dr if the contour is that portion of 
the circle z? + y? = a? from the point (a,0,3) to (—a,0,3). See Figure 4.3.4. 


The parametric equations for this example are zr = acos(0), dx = —a sin(0) d9, y = 
asin(0), dy = acos(0) d0, z = 3, and dz = 0 with 0 < 0 < v. Therefore, 


| F -dr = J ie cos? (0) + a? sin?(0)][-a sin(0) d0] 
C 0 


— 2a? cos(0) sin(0)[a cos(0) d8] + a cos(0) - 0 (4.3.11) 

= zu sin(0) d0 — 2 f cos? (0) sin(0) d0 (4.3.12) 
0 0 

= a? cos(0)|^ + 2a? cos?(0)|; = —2a? — $a? = —19a*. (4.3.13) 


e Example 4.3.5: Circulation 


Let v(x,y,z) denote the velocity at the point (x,y,z) in a moving fluid. If it varies 
with time, this is the velocity at a particular instant of time. The integral fo v-dr around a 
closed path C is called the circulation around that path. The average component of velocity 


along the path is 
$e vsds — fov-dr 


Us 
S S 


(4.3.14) 


where s is the total length of the path. The circulation is thus fo v- dr = Uss, the product 
of the length of the path and the average velocity along the path. When the circulation is 
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x 


Figure 4.3.4: Diagram for the line integration in Example 4.3.4. 


positive, the flow is more in the direction of integration than opposite to it. Circulation is 
thus an indication, and to some extent a measure, of motion around the path. 


Problems 
Evaluate f c E: dr for the following vector fields and curves: 


1. F = ysin(nz)i + z?e"j + 3vzk and C is the curve z = t, y = t°, and z = t? from (0, 0,0) 
o (1,1,1). Use MATLAB to illustrate the parametric curves. 


2. F = yi + zj + 2k and C consists of the line segments from (0,0,0) to (2,3,0), and from 
(2, 3,0) to (2,3, 4). Use MATLAB to illustrate the parametric curves. 


3. F = e*i + ze*"j + zye""?k and C is the curve z = t, y = t°, and z = t? with 0 < t < 2. 
Use MATLAB to illustrate the parametric curves. 


4. F = yzi + zzj + zyk and C is the curve x = #3, y = t?, and z = t with 1 < t < 2. Use 
MATLAB to illustrate the parametric curves. 


5. F = yi — zj + 3zyk and C consists of the semicircle x? + y? = 4, z = 0, y > 0, and the 
line segment from (—2,0,0) to (2,0,0). Use MATLAB to illustrate the parametric curves. 


= (x + 2y)i+ (6y — 2x)j and C consists of the sides of the triangle with vertices 
e ,0,0), (1, 1, D), and (1,1,0). Proceed from (0,0,0) to (1, 1,1) to (1, 1,0) and back to 
0,0,0). Use MATLAB to illustrate the parametric curves. 


Seo 


7. F = 2xzi+4y?j+27k and C is taken counterclockwise around the ellipse z?/4--y?/9 = 1, 
z= 1. Use MATLAB to illustrate the parametric curves. 


8. F = 2ri + yj + zk and C is the contour x = t, y = sin(t), and z = cos(t) + sin(t) with 
0 € t € 2x. Use MATLAB to illustrate the parametric curves. 


9. F = (2y? + z)i + 4xyj + xk and C is the spiral x = cos(t), y = sin(t), and z = t 
with 0 € t € 2m between the points (1,0,0) and (1,0,27). Use MATLAB to illustrate the 
parametric curves. 
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10. F = z?i + y?j + (z? + 2zy)k and C consists of the edges of the triangle with vertices 
at (0,0,0), (1,1,0), and (0,1,0). Proceed from (0,0,0) to (1, 1,0) to (0, 1,0) and back to 
(0,0,0). Use MATLAB to illustrate the parametric curves. 


4.4 THE POTENTIAL FUNCTION 


In Section 4.2 we showed that the curl operation applied to a gradient produces the 
zero vector: V x Vy = 0. Consequently, if we have a vector field F such that Vx F = 0 
everywhere, then that vector field is called a conservative field and we can compute a 
potential y such that F = Vy. 


e Example 4.4.1 


Let us show that the vector field F = ye*" cos(z)i + xe” cos(z)j — e7” sin(z)k is con- 
servative and then find the corresponding potential function. 
'To show that the field is conservative, we compute the curl of F or 


i i k 
ə [] 9 
VxF= Em Em əz =0. (4.4.1) 
ye”? cos(z) xe*"cos(z) —e""sin(z) 


'To find the potential we must solve three partial differential equations: 


Pe = ye"? cos(z) =F - i, (4.4.2) 

Py = ze?" cos(z) =F - j, (4.4.3) 
and 

pz = —e" sin(z) = F-k. (4.4.4) 


We begin by integrating any one of these three equations. Choosing Equation 4.4.2, 
p(x, y, z) = e** cos(z) + f(y, z). (4.4.5) 
To find f(y, z) we differentiate Equation 4.4.5 with respect to y and find that 
Py = xe”” cos(z) + fy(y, z) = ze” cos(z) (4.4.6) 
from Equation 4.4.3. Thus, fy = 0 and f(y, z) can only be a function of z, say g(z). Then, 
plz, y, z) = e7” cos(z) + g(z). (4.4.7) 


Finally, 
pz = —e"" sin(z) + g'(z) = —e"" sin(z) (4.4.8) 


from Equation 4.4.4 and g'(z) = 0. Therefore, the potential is 


p(x, y, z) = e** cos(z) + constant. (4.4.9) 


Potentials can be very useful in computing line integrals, because 


[ras pode + eydy e de | do = e(B) - 9A), (4.4.10) 
C C c 
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where the point B is the terminal point of the integration while the point A is the starting 
point. Thus, any path integration between any two points is path independent. 
Finally, if we close the path so that A and B coincide, then 


j F. dr — 0. (4.4.11) 
C 


It should be noted that the converse is not true. Just because fc F - dr = 0, we do not 
necessarily have a conservative field F. 

In summary then, an irrotational vector in a given region has three fundamental prop- 
erties: (1) its integral around every simply connected circuit is zero, (2) its curl equals zero, 
and (3) it is the gradient of a scalar function. For continuously differentiable vectors, these 
properties are equivalent. For vectors that are only piece-wise differentiable, this is not 
true. Generally the first property is the most fundamental and is taken as the definition of 
irrotationality. 


e Example 4.4.2 


Using the potential found in Example 4.4.1, let us find the value of the line integral 
fo E : dr from the point (0,0,0) to (—1, 2,7). 
From Equation 4.4.9, 


(—1,2,7) 


f F - dr = [e** cos(z) + constant] --1-e?. (4.4.12) 
C (0,0,0) 


Problems 


Verify that the following vector fields are conservative and then find the corresponding 
potential: 


1. F = 2gyi + (x? + 2yz)j + (y? + 4)k 2. F = (2x + 2ze?”)i + (2y — 1)j + &*k 


3. F = yzi + ezj+ cyk 4. F = 2zi + 3y?j + 422k 

5. F = (2x + 5)i + 3y?j + (1/z)k 6. F = [2x sin(y) + e**]i+ x? cos(y)j + (31e?* + 4)k 
7. F = e?*i + 3y?j + 2re?*k 8. F=yi+ (z+ z)j+ yk 

9. F = (z + y)i + zj + zk 10. F = 2xy cos(z)i + x? cos(z)j — z?y sin(z)k. 

4.5 SURFACE INTEGRALS 


Surface integrals appear in such diverse fields as electromagnetism and fluid mechanics. 
For example, if we were oceanographers we might be interested in the rate of volume of 
seawater through an instrument that has the curved surface S. The volume rate equals 
[fa v: ndo, where v is the velocity and ndo is an infinitesimally small element on the 
surface of the instrument. The surface element ndo must have an orientation (given by n) 
because it makes a considerable difference whether the flow is directly through the surface 
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X 


Figure 4.5.1: Diagram for the surface integration in Example 4.5.1. 


or at right angles. In the special case when the surface encloses a three-dimensional volume, 
then we have a closed surface integral. 

To illustrate the concept of computing a surface integral, we will do three examples 
with simple geometries. Later we will show how to use surface coordinates to do more 
complicated geometries. 


e Example 4.5.1 


Let us find the flux out the top of a unit cube if the vector field is F = xi + yj + zk. 
See Figure 4.5.1. 

The top of a unit cube consists of the surface z = 1 with 0 < x < 1 and 0 € y € 1. By 
inspection, the unit normal to this surface is n — k, or n — —k. Because we are interested 
in the flux out of the unit cube, n — k, and 


1 pl 
J| F2 - f 1 (xi + yj +k)-kdzdy= 1, (4.5.1) 
E o Jo 


because z — 1. 


e Example 4.5.2 


Let us find the flux out of that portion of the cylinder y? + z2? = 4 in the first octant 
bounded by x = 0, x = 3, y = 0, and z = 0. The vector field is F = xi + 2zj + yk. See 
Figure 4.5.2. 

Because we are dealing with a cylinder, cylindrical coordinates are appropriate. Let 
y = 2cos(0), z = 2sin(0), and z = x with 0 < 0 < 7/2. To find n, we use the gradient in 
conjunction with the definition of the surface of the cylinder f(x,y,z) = y? +2? = 4. Then, 


2yj + 2zk 
Men OMIT Es A (4.5.2) 


n= = JU 
IVf] 44042 2 2 


because jy? + z? = 4 along the surface. Since we want the flux out of the surface, then 


n = yj/2 + zk/2, whereas the flux into the surface would require n = —yj/2 — zk/2. 
Therefore, 
3 
F -n = (xi + 2zj + yk): (5 =k) = T = 6cos(0) sin(6). (4.5.3) 
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Figure 4.5.2: Diagram for the surface integration in Example 4.5.2. 


What is do? Our infinitesimal surface area has a side in the x direction of length dx and 
a side in the 0 direction of length 2 d0 because the radius equals 2. Therefore, do = 2 dx dé. 
Bringing all of these elements together, 


3 pr/2 3 2/2 3 
[fe ne | " 12cos(0) sin(£) d9 de = 6 | |sim*(0)|; | dx =6 | dx = 18. 
S 0 0 0 0 
(4.5.4) 


As counterpoint to this example, let us find the flux out of the pie-shaped surface at 
x = 3. In this case, y = rcos(0), z = rsin(0), and 


"7/2 p2 7/2 p2 
J| 5:22 - | ] [i+ 2rsin(0)j + reos] -irdrað =3 f | r dr d = 37. 
S 0 0 0 0 
(4.5.5) 


e Example 4.5.3 


Let us find the flux of the vector field F = y?i+ z?j + 5zk out of the hemispheric 
surface x? + y? + z? — a?, z > 0. See Figure 4.5.3. 

We begin by finding the outwardly pointing normal. Because the surface is defined by 
f(£,y, z) =£? +y? +2? =a’, 


2xi + 2yj + 2zk 
Vf xi + 2yj + 2z EU Y; | aie (4.5.6) 


IVf| yA + 4y2 +422 a «a a 
because x? + y? + z? = a?. This is also the outwardly pointing normal since n = r/a, where 
r is the radial vector. 

Using spherical coordinates, x = acos(g)sin(0), y = asin(y) sin(@), and z = acos(0), 
where q is the angle made by the projection of the point onto the equatorial plane, measured 
from the z-axis, and 0 is the colatitude or “cone angle" measured from the z-axis. To 
compute do, the infinitesimal length in the 0 direction is a d0 while in the q direction it 
is a sin(0) dy, where the sin(0) factor takes into account the convergence of the meridians. 
Therefore, do = a? sin(0) d9 dy, and 


2m pr/2 
J| 5:22 - | J (y?i + 2j + 52k) (5i - 34 =k) a?sin(0)d6 dp (4.5.7) 
S 0 0 a a a 


n 
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Figure 4.5.3: Diagram for the surface integration in Example 4.5.3. 


2r pw /2 2 2 2 
J| F2 - | y (3 u LN Je sin(0) d0 do (4.5.8) 
S 0 Jo a d g 


n/2 p2m 
= ri | [a* cos(y) sin? (p) sint (0) 
+ af cos? (p) sin(y) sinf (0) + 5a? cos? (0) sin(0)| dpdð (4.5.9) 


n/2 ad 2m a^ 2m 
= J | sin?(p)| sin*(80) — — cos?(y)} sin^(0) 
o L3 0 3 0 
+ 5a? cos? (8) sialo] dé (4.5.10) 
7/2 1 3 7/2 1 3 
= 10x08 f cos?() sin(0) d0 = — an cos? (0) = an ; (4.5.11) 
0 0 


Although these techniques apply for simple geometries such as a cylinder or sphere, we 
would like a general method for treating any arbitrary surface. We begin by noting that 
a surface is an aggregate of points whose coordinates are functions of two variables. For 
example, in the previous example, the surface was described by the coordinates y and 0. 
Let us denote these surface coordinates in general by u and v. Consequently, on any surface 
we can re-express x, y, and z in terms of u and v: x = z(u,v), y = y(u, v), and z = z(u,v). 

Next, we must find an infinitesimal element of area. The position vector to the surface 
is r = z(u, v)i + y(u, v)j + z(u, v)k. Therefore, the tangent vectors along v = constant, ru, 
and along u — constant, r,, equal 


ru = Zul + Yuj + zuk, (4.5.12) 


and 


ry = Tyi + Yj + Zk. (4.5.13) 


Consequently, the sides of the infinitesimal area are r,, du and r, dv. Therefore, the vectorial 
area of the parallelogram that these vectors form is 


ndo =r, X r, du dv (4.5.14) 


and is called the vector element of area on the surface. Thus, we may convert F . ndo into 
an expression involving only u and v and then evaluate the surface integral by integrating 
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x (2,0,0) 


Figure 4.5.4: Diagram for the surface integration in Example 4.5.4. 


over the appropriate domain in the uv-plane. Of course, we are in trouble if r, x r, = 0. 
Therefore, we only treat regular points where r, x ry Z 0. In the next few examples, we 
show how to use these surface coordinates to evaluate surface integrals. 


e Example 4.5.4 
Let us find the flux of the vector field F = xi + yj + zk through the top of the plane 


3x + 2y + z = 6, which lies in the first octant. See Figure 4.5.4. 
Our parametric equations are x = u, y = v, and z = 6 — 3u — 2v. Therefore, 


r = ui + vj + (6 — 3u — 2v)k, (4.5.15) 
so that 
r, =i— 3k, r,—j-2k, (4.5.16) 
and 
r, X ry = 3i + 2j +k. (4.5.17) 


Bring all of these elements together, 
2 p3—3u/2 2 p3—3u/2 
J| 5:22 - | J (3u +20 +6 — 3u — 2) dudu =6 f i dv du (4.5.18) 
S o Jo o Jo 
2 
- 6 | (3 — 3u/2) du = 6 (3u — łu?) |; = 18. (4.5.19) 
0 


To set up the limits of integration, we note that the area in u,v space corresponds to the 
zy-plane. On the zy-plane, z = 0 and 3u + 2v = 6, along with boundaries u = v = 0. 


e Example 4.5.5 


Let us find the flux of the vector field F = xi 4- yj + zk through the top of the surface 
z = xy + 1, which covers the square 0 < x < 1,0 < y < 1 in the zy-plane. See Figure 4.5.5. 

Our parametric equations are x = u, y = v, and z = uv + 1 with 0 € u < 1 and 
0x v1. Therefore, 


r= ui- vj (uv + 1)k, (4.5.20) 


so that 
ry, —i- vk, ry =j + uk, (4.5.21) 
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Figure 4.5.5: Diagram for the surface integration in Example 4.5.5. 


and 
ry X ty = —vi — uj + k. (4.5.22) 
Bring all of these elements together, 
P x 
ni F -ndo = n | [ui + vj + (uv + D)k] - (-vi — uj + k) du dv (4.5.23) 
S o Jo 
1 pl 1 j 
= li I (1 — uv) du dv = f (u— iu?v) |, dv (4.5.24) 
o Jo 0 
1 
1 
E n (1— $v) dv = (v — 1?) o= 3. (4.5.25) 


e Example 4.5.6 


Let us find the flux of the vector field F = 4xzi + zyz?j + 3zk through the exterior 
surface of the cone z? = x? + y? above the zy-plane and below z = 4. See Figure 4.5.6. 

A natural choice for the surface coordinates is polar coordinates r and 0. Because 
x = r cos(0) and y = rsin(0), z =r. Then, 


r = rcos(0)i + r sin(0)j + rk (4.5.26) 
with 0 € r < 4 and 0 < 0 € 2m so that 
r, = cos(0)i + sin(0)j + kro = —r sin(0)i + r cos(0), (4.5.27) 
and 
r, X rg = —rcos(0)i — rsin(0)j + rk. (4.5.28) 


'his is the unit area inside the cone. Because we want the exterior surface, we must take 
the negative of Equation 4.5.28. Bring all of these elements together, 


"i F.ndo = J is { [4r cos(0)|r[r cos(0)] 


+ [r? sin(6) cos(8)]r?[r sin(0)] — 3r?) d0 dr (4.5.29) 


4 
= f far [0 + 1 sin(20)] pr tr sin? (9)|^" — srol} dr (4.5.30) 
0 


4 
= Arr? — 6rr?) dr = (nri — 2rr? Ta 128m. (4.5.31) 
R 0 
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Figure 4.5.6: Diagram for the surface integration in Example 4.5.6. 
Problems 
Compute the surface integral ff; F -ndo for the following vector fields and surfaces: 


1. F = xi — zj + yk and the surface is the top side of the z = 1 plane where 0 € x < 1 and 
0€ y& 1. 


2. F = zi + yj + zzk and the surface is the top side of the cylinder z? + y? = 9, z = 0, and 
zz 


3. F = xyi + zj + zzk and the surface consists of both exterior ends of the cylinder defined 
by x? +y? = 4, z = 0, and z = 2. 


4. F = xi + zj + yk and the surface is the lateral and exterior sides of the cylinder defined 
by x? +y? = 4, z = —3, and z = 3. 


5. F = xyi + 2?j + yk and the surface is the curved exterior side of the cylinder y? + z2? = 9 
in the first octant bounded by x = 0, x = 1, y = 0, and z = 0. 


6. F = yj + 27k and the surface is the exterior of the semicircular cylinder y? + 2? = 4, 
z > 0, cut by the planes x = 0 and x = 1. 


7. F = zi + zj + yk and the surface is the curved exterior side of the cylinder x? + y? = 4 
in the first octant cut by the planes z = 1 and z = 2. 


8. F = z?i — 2?j + yzk and the surface is the exterior of the hemispheric surface of 
£? +y? + z2 = 16 above the plane z = 2. 


9. F = yi + zj + yk and the surface is the top of the surface z = x + 1, where —1 <x < 1 
and —1 <y<1. 


10. F = zi + zj — 3zk and the surface is the top side of the plane x + y + z = 2a that lies 
above the square 0 < x < a, 0 < y <a in the xy-plane. 


11. F = (y? + z2)i + (a? + 22)j + (a? + y?)k and the surface is the top side of the surface 
z = 1— z? with —1 < x € 1 and -2 < y € 2. 
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12. F = y?i-- zzj-— k and the surface is the cone z = /z? + y2, 0 < z < 1, with the normal 
pointing away from the z-axis. 


13. F = y?i + z?j + 5zk and the surface is the top side of the plane z = y + 1, where 
-l<a<land-l<y<l. 


14. F = —yi + xj + zk and the surface is the exterior or bottom side of the paraboloid 
z =x? +y?, where 0 € z € I. 


15. F = —yi + zj + 62?k and the surface is the exterior of the paraboloids z = 4 — x? — y? 
and z = z?  y?. 


4.6 GREEN'S LEMMA 


Consider a rectangle in the xy-plane that is bounded by the lines x = a, x = b, 
y — c, and y — d. We assume that the boundary of the rectangle is a piece-wise smooth 
curve that we denote by C. If we have a continuously differentiable vector function F — 
P(x,y)i + Q(z, y)j at each point of enclosed region R, then 


ff 84- I Gas ay =f owowa- [ aanas f aena 


(4.6.1) 
where the last integral is a closed line integral counterclockwise around the rectangle because 
the horizontal sides vanish, since dy — 0. By similar arguments, 


nis Z JA =- j. P(z, y) dz (4.6.2) 


If, (5: i a) ies f. P(z, y) dx + Q(z, y) dy. (4.6.3) 


This result, often known as Green's lemma, may be expressed in vector form as 


so that 


fra] V x F- kdA. (4.6.4) 
C R 


Although this proof was for a rectangular area, it can be generalized to any simply 
closed region on the zy-plane as follows. Consider an area that is surrounded by simply 
closed curves. Within the closed contour we can divide the area into an infinite number of 
infinitesimally small rectangles and apply Equation 4.6.4 to each rectangle. When we sum 
up all of these rectangles, we find ffp V x F- kdA, where the integration is over the entire 
surface area. On the other hand, away from the boundary, the line integral along any one 
edge of a rectangle cancels the line integral along the same edge in a contiguous rectangle. 
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(0,0) 


X 


Figure 4.6.1: Diagram for the verification of Green's lemma in Example 4.6.1. 


'Thus, the only nonvanishing contribution from the line integrals arises from the outside 
boundary of the domain fe F - dr. 


e Example 4.6.1 


Let us verify Green's lemma using the vector field F = (3x? — 8y”)i+ (4y — 6xy)j, and 
the enclosed area lies between the curves y = yx and y = z?. The two curves intersect at 
x = 0 and z = 1. See Figure 4.6.1. 

We begin with the line integral: 


1 
j F -dr = | (3a? — 8a*) dx + (4x? — 6x?) (2x dx) 
C 0 


0 
«f (3a? — 8x) da + (411? 6233/2) (1571/2 dx) (4.6.5) 
1 
1 
= f (—20x* + 81? + 11x — 2) dz = 2. (4.6.6) 


In Equation 4.6.6 we used y = x? in the first integral and y = \/z in our return integration. 
For the areal integration, 


1 pve 1 JE 1 
| [ yr- xaa f / 10ydydz = | 5y^|*; d =5 | (r—2*)dz — 83 (4.6.7) 
R 0 Jg? 0 0 


and Green's lemma is verified in this particular case. 


e Example 4.6.2 
Let us redo Example 4.6.1 except that the closed contour is the triangular region defined 


by the lines x = 0, y = 0, and xt +y = 1. 
'The line integral is 


1 
jra-[ (3z? — 8. 0?)dz + (4-0 — 62 -0)-0 
C 0 


+ i [a1 — y)? — 892](—ay) + [y — 6(1 — y)yl dy 
0 


Vector Calculus 173 


Figure 4.6.2: Diagram for the verification of Green's lemma in Example 4.6.3. 


0 
«f (3 - 0? — 8?) -0 + (4y — 6 - 0 - y) dy (4.6.8) 
1 
1 1 1 
al 31? de — | yay + | (—3 + 4y + 113?) dy (4.6.9) 
0 0 0 
1 1 1 
= aes — 2y^|. + (—3y + 2y? + Hy) = 5, (4.6.10) 


On the other hand, the areal integration is 


1 1-2 1 
JJ Vx F-kaA= | / Loy dy de = | y da: (4.6.11) 
R 0 [U 0 
1 


=5 f (1— zy? dz = — siai =š (4.6.12) 


and Green’s lemma is verified in this particular case. o 
e Example 4.6.3 


Let us verify Green’s lemma using the vector field F = (3x + 4y)i + (2x — 3y)j, and the 
closed contour is a circle of radius two centered at the origin of the zy-plane. See Figure 
4.6.2. 

Beginning with the line integration, 


$ F - dr = [e cos(0) + 8sin(0)]|-2 sin(0) d0] + [4 cos(0) — 6sin(0)][2 cos(0) d0] 
C 0 
(4.6.13) 


E Lu [-24 cos(0) sin(0) — 16 sin? (0) + 8 cos?(0)] d0 (4.6.14) 
0 


2n 


= 12 cos?(0) |" — 8 [6 — 4 sin(20)] |" + 4 [0 + 4 sin(20)] |,” = —87. (4.6.15) 
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For the areal integration, 


2 2T 
// VxF-kda= f | —2rd0 dr = —8r (4.6.16) 
R 0 Jo 


and Green's lemma is verified in the special case. 
Problems 
Verify Green's lemma for the following two-dimensional vector fields and contours: 


1. F = (a? + Ay)i + (y — x)j and the contour is the square bounded by the lines x = 0, 
y—0,vr—1,andy- 1. 


2. F = (x — y)i + zyj and the contour is the square bounded by the lines x = 0, y = 0, 
x—]1l,andy-l. 


3. F = —y?i + z?j and the contour is the triangle bounded by the lines x = 1, y = 0, and 
yar 


4. F = (xy — z?)i + z?yj and the contour is the triangle bounded by the lines y = 0, z = 1, 
and y = x. 


5. F = sin(y)i + xcos(y)j and the contour is the triangle bounded by the lines x + y = 1, 
y—z-]1,and y — 0. 


6. F = y?i + z?j and the contour is the same contour used in Problem 4. 


7. F=—y?i-+ z?j and the contour is the circle z? + y? = 4. 


8. F = —27i+ zy?j and the contour is the closed circle of radius a. 
9. F = (6y + x)i + (y + 22)j and the contour is the circle (x — 1)? + (y — 2)? = 4. 


10. F = (a+ y)i+ (27? — y?)j and the contour is the boundary of the region determined 
by the curves y — z? and y — 4. 


11. F = 3yi + 2xj and the contour is the boundary of the region determined by the curves 
y =Oand y = sin(x) with 0 € x < m. 


12. F = —16yi + (4e" + 322)j and the contour is the pie wedge defined by the lines y = x, 
y = —z, x? +y? = 4, and y > 0. 


4.7 STOKES’ THEOREM* 


In Section 4.2 we introduced the vector quantity V x v, which gives a measure of the 
rotation of a parcel of fluid lying within the velocity field v. In this section we show how 
the curl can be used to simplify the calculation of certain closed line integrals. 


4 For the history behind the development of Stokes’ theorem, see Katz, V. J., 1979: The history of 
Stokes’ theorem. Math. Mag., 52, 146-156. 
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Sir George Gabriel Stokes (1819-1903) was Lucasian Professor of Mathematics at Cambridge Uni- 
versity from 1849 until his death. Having learned of an integral theorem from his friend Lord Kelvin, 
Stokes included it a few years later among his questions on an examination that he wrote for the 
Smith Prize. It is this integral theorem that we now call Stokes’ theorem. (Portrait courtesy of the 
Royal Society of London.) 


This relationship between a closed line integral and a surface integral involving the curl 


is: 


Stokes’ Theorem: The circulation of F = Pi+ Qj+ Rk around the closed boundary C 
of an oriented surface S in the direction counterclockwise with respect to the surface’s unit 
normal vector n equals the integral of V x F -n over S, or 


fram || VxF ndo. (4.7.1) 
C S 


Stokes' theorem requires that all of the functions and derivatives be continuous. 

The proof of Stokes’ theorem is as follows: Consider a finite surface S whose boundary 
is the loop C. We divide this surface into a number of small elements ndo and compute 
the circulation dI = f, F - dr around each element. When we add all of the circulations 
together, the contribution from an integration along a boundary line between two adjoining 
elements cancels out because the boundary is crossed once in each direction. For this reason, 
the only contributions that survive are those parts where the element boundaries form part 
of C. Thus, the sum of all circulations equals fc F - dr, the circulation around the edge of 
the whole surface. 

Next, let us compute the circulation another way. We begin by finding the Taylor 
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expansion for P(z,y, z) about the arbitrary point (xo, yo, 20): 


OP (xo, yo, 20) OP (xo, yo, Zo) 


P(x,y,z) = P(£0, yo; 20) + (£ — o) t (y — vo) 


Ox Oy 
P 
ES (z m2 (£o, yo; zo) us (4.7.2) 
Oz 
with similar expansions for Q(z, y, z) and R(z, y, z). Then 
P 
dT = j F -dr = Plo, w020) $ dz + 3P (ro, Yo, 20) jc Xo) dx (4.7.3) 
L L Ox L 
OP(20, yo, Z OQ(x0, Yo, Z 
" (£0, Yo 2 fiy dudas Qo. yo 94e mdp 
Oy L Ox T 


where L denotes some small loop located in the surface S. Note that integrals such as f, dx 
and $, (x — £o) dx vanish. 

If we now require that the loop integrals be in the clockwise or positive sense so that 
we preserve the right-hand screw convention, then 


n-kõo = dz zo) dy =~ d (v — yo) dz (4.7.4) 

L L 
n-j50 = $ (e - z) de =~ $ (a ~ zo) dz, (4.7.5) 

L L 
n-ido = $ (y—yo)dz =- $ (2-20) dv, (4.7.6) 

L L 

and 
_ Gf OR ƏQ\., OP ORA, oQ OP u 

a - (05-221 nie e (27 - 054 uic + (22-2) x nóc —-VxF-nóc. 
(4.7.7) 


Therefore, the sum of all circulations in the limit when all elements are made infinitesimally 
small becomes the surface integral ff s V X F; ndo and Stokes’ theorem is proven. 


In the following examples we first apply Stokes' theorem to a few simple geometries. 
We then show how to apply this theorem to more complicated surfaces.? 


e Example 4.7.1 
Let us verify Stokes’ theorem using the vector field F = z?i 4- 2j + z?k, and the closed 


curve is a square with vertices at (0,0, 3), (1,0,3), (1, 1, 3), and (0, 1,3). See Figure 4.7.1. 
We begin with the line integral: 


fra f Foart | Foart | Par. | F - dr, (4.7.8) 
C Cy C2 C3 C4 


5 Thus, different Stokes for different folks. 
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Figure 4.7.1: Diagram for the verification of Stokes’ theorem in Example 4.7.1. 


where C1, C», C3, and C4 represent the four sides of the square. Along Ci, x varies while 
y — 0 and z — 3. Therefore, 


1 
| Pedr = | z?’ dx+2c-04+9-0=%, (4.7.9) 
Cy 0 
because dy = dz = 0, and z = 3. Along C5, y varies with x = 1 and z = 3. Therefore, 
1 
/ Pedr = | 17-042-1-dy+9-0=2. (4.7.10) 
C2 0 
Along C3, x again varies with y = 1 and z = 3, and so, 
0 
i F-dr= f xz? dz + 22-0+9-0=-4. (4.7.11) 
C3 1 


Note how the limits run from 1 to 0 because x is decreasing. Finally, for C4, y again varies 
with z — 0 and z = 3. Hence, 


0 
[a= 02-0 +2-0-dy+9-0=0. (4.7.12) 
C4 1 


Hence, 
j F.dr = 2. (4.7.13) 
C 


'Turning to the other side of the equation, 


i j k 
VxF=|ġ È |=. (4.7.14) 
z? 2g z? 


Our line integral has been such that the normal vector must be n — k. Therefore, 


1 pl 
[[vxP nas = | / 2k - k dz dy = 2 (4.7.15) 
S o Jo 
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(0,a,1) 


(a,0,1) 


X 


Figure 4.7.2: Diagram for the verification of Stokes’ theorem in Example 4.7.2. 


and Stokes’ theorem is verified for this special case. 


e Example 4.7.2 
Let us verify Stokes’ theorem using the vector field F = (x? — y)i + 4zj + z?k, where 
the closed contour consists of the x and y coordinate axes and that portion of the circle 


x? + y? =a? that lies in the first quadrant with z = 1. See Figure 4.7.2. 
The line integral consists of three parts: 


fra F-dr+ | F-dr+ | F dr. (4.7.16) 
C Cy C2 C3 
Along C, x varies while y = 0 and z = 1. Therefore, 
a a? 
J Pedr = | (2? —0)de+4-1-0+2?-0=—. (4.7.17) 
€i 0 3 


Along the circle C2, we use polar coordinates with x = acos(t), y = asin(t), and z = 1. 
Therefore, 


n/2 
i F - dr = n [a? cos? (t) — asin(t)|[—asin(t) dt] + 4 - 1 - acos(t) dt + a? cos? (t) - 0, 
Co 0 


(4.7.18) 
n/2 
= J —a? cos? (t) sin(t) dt + a? sin? (t) dt + 4a cos(t) dt (4.7.19) 
0 
a3 1/2 a? 1 7/2 1/2 
3 ; : 
-——ecos"(t) + = [t— zsin(2t) + Aa sin(t) (4.7.20) 
0 2 2 0 0 
a? ar 
= —— + — +4 4.7.21 
3 + 1 + 4a, (4.7.21) 


because dx = —asin(t) dt, and dy = acos(t) dt. Finally, along C3, y varies with z = 0 and 
z = 1. Therefore, 


0 
f F-dr= f (9 -y)-0+4:1-dy+0?:0= —4a, (4.7.22) 
C3 a 
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Figure 4.7.3: Diagram for the verification of Stokes’ theorem in Example 4.7.3. 


so that " 
$ F- dr = =. (4.7.23) 
C 4 


'Turning to the other side of the equation, 


i j k 
VxF=| & & &—-4-2xjk (4.7.24) 
x?—y 4z r 


From the path of our line integral, our unit normal vector must be n = k. Then, 


a pr/2 2 
JT V x F.ndo =| if [—4i — 2r cos(0)j + k] - kr dé dr = T (4.7.25) 
S 0 0 


and Stokes! theorem is verified for this case. 


e Example 4.7.3 


Let us verify Stokes’ theorem using the vector field F = 2yzi— (x +3y — 2)j + (x? + z)k, 
where the closed triangular region is that portion of the plane x +y +z = 1 that lies in the 
first octant. 

As shown in Figure 4.7.3, the closed line integration consists of three line integrals: 


fra f Foart | Fh. | F - dr. (4.7.26) 
C Cı C2 Cs 


Along C1, z = 0 and y = 1 — x. Therefore, using x as the independent variable, 


0 
0 
i Fdr= | 2(1—2)-0-da—(a+3—32—2)(—dx)+(x?+0)-0 = —2?|, c z|] — 0. (4.7.27) 


Along C2, x = 0 and y = 1 — z. Thus, 


1 
[raf 2(1— z)2-0—(04-3—3z—2)( dz) + (0 +z) dz == $2? +2+127|) — 0. 
C2 0 

(4.7.28) 
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Finally, along C3, y 2 0 and z 2 1 — x. Hence, 


1 
[re 2-0-(1—2) dz — (z--0—2)-0-- (z? -1—z)(-dx) = — $x’ eieh = 5, 
C3 0 


(4.7.29) 
Thus, 
f F- dr = —2 (4.7.30) 
C 
On the other hand, 
i j k 
VxF=|2 bn 2 | = (-22 + 2y)j + (-1— 22)k. (4.7.31) 
Qyz —z—3y42 zr?+z 


To find ndo, we use the general coordinate system x = u, y = v, and z = 1 — u — v. 
Therefore, r = ui + vj + (1 — u — v)k and 


ij k 
ru Xr =|1 0 —1|=i+j+k. (4.7.32) 
0 1 —1 


Thus, 


J| V9 nae | | [((—2u + 2v)j + (C1 — 2 + 2u + 20)k] - [i+ j +k] dv du 
(4.7.33) 


= rà ee dus fea —-u?-3(-w)du (47.34) 
0 0 0 


1 
= | (—1 — u + 2u?) du = -2 (4.7.35) 
0 


and Stokes’ theorem is verified for this case. 
Problems 
Verify Stokes’ theorem using the following vector fields and surfaces: 


1. F = 5yi — 5xj + 3zk and the surface S is that portion of the plane z = 1 with the square 
at the vertices (0,0, 1), (1,0,1), (1,1,1), and (0, 1, 1). 


2. F = «i+ y?j + z?k and the surface S is the rectangular portion of the plane z = 2 
defined by the corners (0, 0, 2), (2,0, 2), (2,1, 2), and (0, 1,2). 


3. F = zi + zj + yk and the surface S is the triangular portion of the plane z = 1 defined 
by the vertices (0,0, 1), (2,0, 1), and (0,2, 1). 


4. F = 2zi — 3rj + Ayk and the surface S is that portion of the plane z = 5 within the 
cylinder z? 4- y? — 4. 
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5. F = zi + zj + yk and the surface S is that portion of the plane z = 3 bounded by the 
lines y = 0, x = 0, and z? + y? = 4. 


6. F = (22+ x)i + (y — z)j + (x + y)k and the surface S is the interior of the triangularly 
shaped plane with vertices at (1, 0,0), (0, 1,0), and (0,0, 1). 


7. F = zi + zj + yk and the surface S is that portion of the plane 2x + y + 2z = 6 in the 
first octant. 


8. F = zi + zzj + yk and the surface S is that portion of the paraboloid z = 9 — x? — y? 
within the cylinder x? + y? = 4. 


4.8 DIVERGENCE THEOREM 


Although Stokes’ theorem is useful in computing closed line integrals, it is usually very 
difficult to go the other way and convert a surface integral into a closed line integral because 
the integrand must have a very special form, namely V x F -n. In this section we introduce 
a theorem that allows with equal facility the conversion of a closed surface integral into a 
volume integral and vice versa. Furthermore, if we can convert a given surface integral into 
a closed one by the introduction of a simple surface (for example, closing a hemispheric 
surface by adding an equatorial plate), it may be easier to use the divergence theorem 
and subtract off the contribution from the new surface integral rather than do the original 
problem. 

This relationship between a closed surface integral and a volume integral involving the 
divergence operator is: 


The Divergence or Gauss's Theorem: Let V be a closed and bounded region in three- 
dimensional space with a piece-wise smooth boundary S that is oriented outward. Let 
F = P(a,y,z)i+ Q(2,y,z)j + R(z,y,z)k be a vector field for which P, Q, and R are 
continuous and have continuous first partial derivatives in a region of three-dimensional 
space containing V. Then 


ferme = fff v nav (4.8.1) 


Here, the circle on the double integral signs denotes a closed surface integral. 

A nonrigorous proof of Gauss's theorem is as follows. Imagine that our volume V is 
broken down into small elements dr of volume of any shape so long as they include all of 
the original volume. In general, the surfaces of these elements are composed of common 
interfaces between adjoining elements. However, for the elements at the periphery of V, 
part of their surface will be part of the surface S that encloses V. Now d$ = V.Fdr is 
the net flux of the vector F out from the element dr. At the common interface between 
elements, the flux out of one element equals the flux into its neighbor. Therefore, the sum 


of all such terms yields 
o= fff V.Fdr (4.8.2) 
V 
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Carl Friedrich Gauss (1777-1855), the prince of mathematicians, must be on the list of the greatest 
mathematicians who ever lived. Gauss, a child prodigy, is almost as well known for what he did not 
publish during his lifetime as for what he did. This is true of Gauss's divergence theorem, which he 
proved while working on the theory of gravitation. It was only when his notebooks were published 
in 1898 that his precedence over the published work of Ostrogradsky (1801-1862) was established. 
(Portrait courtesy of Photo AKG, London, with permission.) 


and all of the contributions from these common interfaces cancel; only the contribution 
from the parts on the outer surface S is left. These contributions, when added together, 


give df, F - n dc over S and the proof is completed. 


e Example 4.8.1 


Let us verify the divergence theorem using the vector field F = 4zi — 2y?j + z?k and 
the enclosed surface is the cylinder x? + y? = 4, z = 0, and z = 3. See Figure 4.8.1. 
We begin by computing the volume integration. Because 


. O(4x) , 0(-2y) , A(z?) 
MS "Oy Oz 


Ox 
J| veer = fff a - m2 (4.8.4) 


3 p2 p2r 
= J n | [4 — 4r sin(0) + 22] dü r dr dz (4.8.5) 
o Jo Jo 


= 4 — 4y + 2z, (4.8.3) 


3 p2 
= I T jog +4r cos(8) [7^ + 2202" r dr dz (4.8.6) 
o Jo 


3 p2 3 
| | (87 + 4nz)rdrdz = ji An(2 + zi dz (4.8.7) 
o Jo 0 


3 
= an | 2(2 + z) dz = 8n(2z + Ley = 84r. (4.8.8) 
0 
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Figure 4.8.1: Diagram for the verification of the divergence theorem in Example 4.8.1. 


Turning to the surface integration, we have three surfaces: 


dr nas = ff P-ndo + |f F-ndo+ |f F -ndo. (4.8.9) 
S Si S2 S3 


The first integral is over the exterior to the cylinder. Because the surface is defined by 


Vf 2xi + 2yj Ba A t 
n= É—li-c.J 4.8.10 
IVA 4r? +4y2 2 2 ( ) 


Therefore, 


JE nda = Jf (22? — y?) Jao = f [fe 2cos(0) — [2sin(0)?) 2d0dz (4.8.11) 


= -sf [ts 1 + cos(20)] — sin(0) + cos?(0) es dz (4.8.12) 


2n 


= -uf E + 1 sin(20) + cos(#) — eo) dz (4.8.13) 


0 


3 
= 16s | dz = 487, (4.8.14) 
0 


because x = 2cos(0), y = 2sin(0), and do = 2d6 dz in cylindrical coordinates. 
Along the top of the cylinder, z = 3, the outward pointing normal is n = k, and 
do = r dr d0. Then, 


20 2 
ni F-ndo= ff zs [ li 9r dr d0 = 2r x 9 x 2 = 36r. (4.8.15) 
So So 0 0 


However, along the bottom of the cylinder, z = 0, the outward pointing normal is n = —k 
and do = r dr d0. Then, 


2T 2 
Jh PF ndo= ff do = | | Or dr dé = 0. (4.8.16) 
S3 S3 0 0 
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Consequently, the flux out of the entire cylinder is 


gp F -ndo = 487 + 367 +0 = 84r, (4.8.17) 
S 


and the divergence theorem is verified for this special case. 
e Example 4.8.2 


Let us verify the divergence theorem given the vector field F = 3z?y?i + yj — 6ry?zk 
and the volume is the region bounded by the paraboloid z = x? + y?, and the plane z = 2y. 
See Figure 4.8.2. 

Computing the divergence, 


0(3a?y?) , 20) , 0(—6xy?z) 


.F= i 
X Ox Oy Oz 


= 6zy? +1 — 6zy? = 1. (4.8.18) 


Then, 


m p2sin(0) f2rsin(0) 
| v.rav = fff av= | J ni dz r dr d0 (4.8.19) 
V V 0 J0 T2 


m p2sin(0) 

= 1 J [2r sin(0) — r°] r dr dO (4.8.20) 
0 Jo 
T 2sin(0) 2sin(0) 

x E sin(0) — 1r* |æ (4.8.21) 
0 0 0 

= 1 [18 sin^(8) — 4sin*(0)] d0 = y $ sin^(0) d0 (4.8.22) 
0 0 

= 2! [1 — 2cos(20) + cos?(20)] d0 (4.8.23) 

0 
E aL — sin(20)| + 56] + isin(40) | = §, (4.8.24) 
0 0 0 0 


The limits in the radial direction are given by the intersection of the paraboloid and plane: 
r? = 2r sin(0), or r = 2sin(0), and y is greater than zero. 
Turning to the surface integration, we have two surfaces: 


fp ndo = || F-nds « |f F - ndo, (4.8.25) 
S Sı S2 


where $1 is the plane z = 2y, and S» is the paraboloid. For either surface, polar coordinates 
are best so that x = rcos(0), and y = rsin(0). For the integration over the plane, z = 
2r sin(0). Therefore, 


r—rcos(0)i + rsin(0)j + 2r sin(0)k, (4.8.26) 
so that 
r, = cos(0)i + sin(0)j + 2sin(0)k, (4.8.27) 
and 
rg = —rsin(0)i + r cos(0)j + 2r cos(0)k. (4.8.28) 
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Figure 4.8.2: Diagram for the verification of the divergence theorem in Example 4.8.2. The dashed line 
denotes the curve r = 2sin(0). 


'Then, 
i i k 
r, x rg =| cos(0) sin(0) 2sin(@) | 2 —2rj + rk. (4.8.29) 
—rsin(0) rcos(@) 2rcos(0) 


'This is an outwardly pointing normal so that we can immediately set up the surface integral: 


Ihe ndo= f. ae 3r^ cos ?(0) sin ?(8)i +rsin(0)j 


— 6[2r sin(0)][r cos(0)][r? sin? (0)|k} - (—2rj+rk)drd@ — (4.8.30) 


2sin(0) 
= 2 f [-2r? sin(0) — 12r? sin? (0) cos(0)] dr d8 (4.8.31) 
0 
= i: |i in(0) — 2r BI sin? (0) eost) d (4.8.32) 
0 
z f E sin'(0) — 128sin?(0) eos) dd (4.8.33) 
0 
= -4 folz — sin(20)|5 + 40| + EUM — € sin'?(9)|" — (4.8.34) 
= —2n. (4.8.35) 
For the surface of the paraboloid, 
r = r cos(0)i + r sin(0)j + r?k, (4.8.36) 
so that 
r, = cos(0)i + sin(0)j + 2rk, (4.8.37) 
and 


rg = —rsin(0)i + r cos(0)j. (4.8.38) 
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'Then, 


i j k 
r,xrg-—| cos(0) sin() 2r| = —2r? cos(0)i — 2r? sin(0)j + rk. (4.8.39) 
—rsin(0) rcos(0) 0 


This is an inwardly pointing normal, so that we must take the negative of it before we do 
the surface integral. Then, 


m p2sin(0 
n -ndo = l f (3r* cos? (0) sin?(0)i + r sin(0)j — 6r’ [r cos(0)][r? sin?(0)]k} 
- [2r? cos(0)i + 2r? sin(8)j — rk] dr dO (4.8.40) 


2sin(0 
= | | [6r° cos? (8) sin? (6) + 2r? sin?(0) + 6r? cos(6) sin? ()] dr d6 
(4.8.41) 
si [pgo cos? (0) sin? (0) + ir aps ? sin?(0) 
0 


7|2sin(0) 
lo 


+ $r cos(0) su't) dé (4.8.42) 


= | 1 188 sin? (8) [1 — sin?(8)] cos(@) + 8 sin? (0) + 788 sin? (0) cos(0) } d 
0 


(4.8.43) 
= 15% sin? (9)|* — € sin ?(9)|^ + fu — cos(20)]? do (4.8.44) 
0 
= ji T — 3.cos(20) + 3 cos? (20) — cos(20)[1 — sin?(20) a8 (4.8.45) 
0 


= zl — $ sin(20) lo + 3[8 + Isin(46)] No — isin(20) ot 3 sin #(26)|7 (4.8.46) 


=T +T = ŠT. (4.8.47) 


Consequently, 
ff F-ndo = —2r + 2x = im, (4.8.48) 
S 


and the divergence theorem is verified for this special case. 
e Example 4.8.3: Archimedes' principle 


Consider a solid? of volume V and surface S that is immersed in a vessel filled with a 
fluid of density p. The pressure field p in the fluid is a function of the distance from the 
liquid/air interface and equals 


P = po — pgz, (4.8.49) 


6 Adapted from Altintas, A., 1990: Archimedes’ principle as an application of the divergence theorem. 
IEEE Trans. Educ., 33, 222. 
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where g is the gravitational acceleration, z is the vertical distance measured from the in- 
terface (increasing in the k direction), and po is the constant pressure along the liquid/air 
interface. 

If we define F = —pk, then F-n dø is the vertical component of the force on the surface 
due to the pressure and ff F - ndo is the total lift. Using the divergence theorem and 
noting that V - F = pg, the total lift also equals 


Jh vrav =v f] dV = pgV, (4.8.50) 
V V 


which is the weight of the displaced liquid. This is Archimedes’ principle: The buoyant force 
on a solid immersed in a fluid of constant density equals the weight of the fluid displaced. 


e Example 4.8.4: Conservation of charge 


Let a charge of density p flow with an average velocity v. Then the charge crossing the 
element dS per unit time is pv - dS = J- dS, where J is defined as the conduction current 
vector or current density vector. The current across any surface drawn in the medium is 


fi, J - dS. 


The total charge inside the closed surface is fff p dV. If there are no sources or sinks 
inside the surface, the rate at which the charge decreases is — f ffy p; dV. Because this 
change is due to the outward flow of charge, 


E OP dee pea . dS. (4.8.51) 
Applying the divergence theorem, 


[ff (2e o) av =0 assa) 


Because the result holds true for any arbitrary volume, the integrand must vanish identically 
and we have the equation of continuity or the equation of conservation of charge: 


— 4V- J=0. (4.8.53) 


Problems 
Verify the divergence theorem using the following vector fields and volumes: 


1. F = z?i-- y?j + z2k and the volume V is the cube cut from the first octant by the planes 
r—1,y-—1l,andz- |l. 


2. F = xyi + yzj + zzk and the volume V is the cube bounded by O <2 <1,0<y <1, 
and 0 € z € 1. 


3. F = (y— x)i+ (z—y)j+ (y — x)k and the volume V is the cube bounded by —1 < z < 1, 
—-l<y<l,and-l<z<l. 
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4. F = x7i+ yj + zk and the volume V is the cylinder defined by the surfaces x? + y? = 1, 
z — 0, and z — 1. 


5. F = x7i+y?j+27k and the volume V is the cylinder defined by the surfaces z? + y? = 4, 
z — 0, and z — 1. 


6. F = yi + zz?j + (z — 1)?k and the volume V is the cylinder bounded by the surface 
x? + y? = 4, and the planes z = 1 and z = 5. 


7. F = 6ryi+4yzj+ze ?k and the volume V is that region created by the plane x+y+z = 1, 
and the three coordinate planes. 


8. F = yi + zyj — zk and the volume V is that solid created by the paraboloid z = x? + y? 
and plane z — 1. 


Further Readings 


Davis, H. F., and A. D. Snider, 1995: Introduction to Vector Analysis. Wm. C. Brown 
Publ., 416 pp. Designed as a reference book for engineering majors. 


Kendall, P. C., and D. E. Bourne, 1992: Vector Analysis and Cartesian Tensors. Wm. 
C. Brown, Publ., 304 pp. A clear introduction to the concepts and techniques of vector 
analysis. 


Matthews, P. C., 2005: Vector Calculus. Springer, 200 pp. A good book for self-study with 
complete solutions to the problems. 


Schey, H. M., 2005: Div, Grad, Curl, and All That. Chapman & Hall, 176 pp. A book to 
hone your vector calculus skills. 
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Chapter 5 


Fourier Series 


In differential calculus you developed the technique of representing a function by the 
Taylor series: 


oo 

xS i?@ n 

Te» d G-2*. (5.0.1) 
n=0 

A Taylor expansion is particularly useful for approximating functions in an interval near 

the point of expansion x = a. In this chapter we derive an alternate expansion, called the 

Fourier series, which approximates a function from a sum of sine and cosines: 


f(x) = b D» cos (777) n sin( Z2). (5.0.2) 


The Fourier series converges to the function in the mean over the entire interval (—L, L). 
This convergence generally improves as more and more sines and cosines (harmonics) are 
included. 

An obvious question is: Why do we need such an expansion? Why use sines and 
cosines? As we shall see in Chapter 12 we could have used other functions. Although there 
are several different ways of explaining our choice of Equation 5.0.2, the most direct is 
its use in the solution of linear partial differential equations in rectangular coordinates in 
Chapters 8 to 10. There, our need to re-express a function as a sum of sine or cosines will 
justify our interest. 

Since its development in the latter half of the eighteenth and beginning half of the 
nineteen centuries for the solution of linear partial differential equations, Fourier analysis 
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has taken on a life of its own. For example, it is used to describe physical processes in 
which events recur in a regular pattern such as a musical note which consists of a simple 
note, called the fundamental, and a series of auxiliary vibrations, called overtones. For this 
reason we devote this chapter to the development of Fourier series, its properties, and some 
of its applications outside of partial differential equations. Later on, when we study the 
wave, heat and Laplace's equations, we will use them there to solve these equations. 


5.1 FOURIER SERIES 


One of the crowning glories! of nineteenth-century mathematics was the discovery that 


the infinite series 
f(t)— Pt denen) +b sin("™) (5.1.1) 


can represent a function f(t) under certain general conditions. This series, called a Fourier 
series, converges to the value of the function f(t) at every point in the interval [—L, L] with 
the possible exceptions of the points at any discontinuities and the endpoints of the interval. 
Because each term has a period of 2L, the sum of the series also has the same period. The 
fundamental of the periodic function f(t) is the n = 1 term while the harmonics are the 
remaining terms whose frequencies are integer multiples of the fundamental. We must now 
find some easy method for computing the coefficients an and b, for a given function f(t). 
As a first attempt, we integrate Equation 5.1.1 term by term? from —L to L. On the right 
side, all of the integrals multiplied by an and bn vanish because the average of cos(nmt/L) 
and sin(nat/L) is zero. Therefore, we are left with 


L 
ao = ae f(t) dt. (5.1.2) 


Consequently ao is twice the mean value of f(t) over one period. 
We next multiply each side of Equation 5.1.1 by cos(mmt/ L), where m is a fixed integer. 
Integrating from —L to L, 


L L eo L 
t t t t 
f ro) a- 2 f oC) [m Cr) T) ae 


o x nmt mrt 
+ b sin| —— } cos| —— | dt. 5.1.3 
3 f er) Cr) nS 
n=1 
1 “Fourier’s Theorem ... is not only one of the most beautiful results of modern analysis, but may be 


said to furnish an indispensable instrument in the treatment of nearly every recondite question in modern 
physics. To mention only sonorous vibrations, the propagation of electric signals along a telegraph wire, 
and the conduction of heat by the earth’s crust, as subjects in their generality intractable without it, is to 
give but a feeble idea of its importance.” (Quote taken from Thomson, W., and P. G. Tait, 1879: Treatise 
on Natural Philosophy, Part 1. Cambridge University Press, Section 75.) 


? We assume that the integration of the series can be carried out term by term. This is sometimes 
difficult to justify but we do it anyway. 
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The ag and b, terms vanish by direct integration. Finally, all of the a, integrals vanish 
when n Z m. Therefore, Equation 5.1.3 simplifies to 


an = k f(t) cos( 22t) dt, (5.1.4) 


because qe cos?(nzt/ L) dt = L. Finally, by multiplying both sides of Equation 5.1.1 by 
sin(mat/L) (m is again a fixed integer) and integrating from —L to L, 


1 f? . (nit 
bn = if, f(t) sin“) dt. (5.1.5) 


Although Equation 5.1.2, Equation 5.1.4, and Equation 5.1.5 give us ao, an, and b,, for 
periodic functions over the interval [—L, L], in certain situations it is convenient to use the 
interval [7,7 + 2L], where 7 is any real number. In that case, Equation 5.1.1 still gives the 


Fourier series of f(t) and 
1 7T+2L 
ag = zl f(t) dt, 
1 T+2L t 
Qn = al f(t) cos( 27t) dt, (5.1.6) 
1 7T+2L t 
bn = 1! f(t) sn (^) dt 


These results follow when we recall that the function f(t) is a periodic function that extends 
from minus infinity to plus infinity. The results must remain unchanged, therefore, when 
we shift from the interval [—L, L] to the new interval [7,7 + 2L]. 

We now ask the question: what types of functions have Fourier series? Secondly, if a 
function is discontinuous at a point, what value will the Fourier series give? Dirichlet?:* 
answered these questions in the first half of the nineteenth century. His results may be 
summarized as follows. 


Dirichlet's Theorem: If for the interval |- L, L] the function f(t) (1) is single-valued, 
(2) is bounded, (3) has at most a finite number of maxima and minima, and (4) has only 
a finite number of discontinuities (piecewise continuous), and if (5) f(t + 2L) = f(t) for 
values of t outside of |- L, L], then 


N 
f(t) 2 Yes (T) +b, sin("™) (5.1.7) 


3 Dirichlet, P. G. L., 1829: Sur la convergence des séries trigonométriques qui servent à représenter une 
fonction arbitraire entre des limites données. J. Reine Angew. Math., 4, 157—169. 


^ Dirichlet, P. G. L., 1837: Sur l'usage des intégrales définies dans la sommation des séries finies ou 
infinies. J. Reine Angew. Math., 17, 57-67. 
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A product of the French Revolution, (Jean Baptiste) Joseph Fourier (1768-1830) held positions 
within the Napoleonic Empire during his early career. After Napoleon's fall from power, Fourier 
devoted his talents exclusively to science. Although he won the Institut de France prize in 1811 for 
his work on heat diffusion, criticism of its mathematical rigor and generality led him to publish the 
classic book Théorie analytique de la chaleur in 1823. Within this book he introduced the world to 
the series that bears his name. (Portrait courtesy of the Archives de l'Académie des sciences, Paris.) 


converges to f(t) as N — oo at values of t for which f(t) is continuous and to [f (t^) + 


f(t*)] at points of discontinuity. Here f (t^) equals the value of the function at a point that 
is located infinitesimally to the left of t while f(t*) equals the value of the function at a 
point that is located infinitesimally to the right of t. The coefficients in Equation 5.1.7 are 
given by Equation 5.1.2, Equation 5.1.4, and Equation 5.1.5. A function f(t) is bounded if 
the inequality | f(£)| < M holds for some constant M for all values of t. Because Dirichlet’s 
conditions (1)-(4) are very mild, it is very rare that a convergent Fourier series does not 
exist for a function that appears in an engineering or scientific problem. 


e Example 5.1.1 


Let us find the Fourier series for the function 


0, —7<t<0O, 
f(t) = l2 AEN (5.1.8) 


We compute the Fourier coefficients a, and b, using Equation 5.1.6 by letting L = 7 
and 7 = —7. We then find that 


ape A= » [tat= da (5.1.9) 
0 


Fourier Series 193 


Second to Gauss, Peter Gustav Lejeune Dirichlet (1805-1859) was Germany's leading mathematician 
during the first half of the nineteenth century. Initially drawn to number theory, his later studies 
in analysis and applied mathematics led him to consider the convergence of Fourier series. These 
studies eventually produced the modern concept of a function as a correspondence that associates 
with each real x in an interval some unique value denoted by f(x). (Taken from the frontispiece of 
Dirichlet, P. G. L., 1889: Werke. Druck und Verlag von Georg Reimer, 644 pp.) 


"_cos(nm)—1  (-1)"-1 


s f T = 1 cmm " c 
0 


T T n n? " n?gz n?m 
(5.1.10) 
because cos(n7) = (—1)”, and 
E ga 1 [-tcos(nt in(nt)]|* arent 
b, = Ji tsin(nt) dt = | UNE > J ENT EN (5.1.11) 
T Jo T n n 0 n n 
for n = 1,2,3,.... Thus, the Fourier series for f(t) is 
qx ae eel [ODE 
f(t) — 4 4 5 -z cos(nt) + —— sin(nt) (5.1.12) 


a ae € cum 


We note that at the points t = +(2n — 1)z, where n = 1,2,3,..., the function jumps 
from zero to m. To what value does the Fourier series converge at these points? From 
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— mean plus 1 term 
CEU -í 4 


— mean plus 2 terms 


c4 -2 0 2 4 c4 -2 0 2 4 


— mean plus 3terms — , — mean plus 4 terms 
E aay - = f(t) 


=4 -2 0 2 4 c4 -2 0 2 4 


— mean plus 6 terms 
— - f(t) 


=4 E 0 2 4 c4 -2 0 2 4 


Figure 5.1.1: Partial sum of the Fourier series for Equation 5.1.8. 


Dirichlet's theorem, the series converges to the average of the values of the function just 
to the right and left of the point of discontinuity, i.e., (m + 0)/2 = 7/2. At the remaining 
points the series converges to f(t). 

Figure 5.1.1 shows how well Equation 5.1.12 approximates the function by graphing 
various partial sums of this expansion as we include more and more terms (harmonics). The 
MATLAB script that created this figure is: 


clear; 
= [-4:0.1:4]; % create time points in plot 
zeros(size(t)); % initialize function f(t) 
for k = 1:length(t) % construct function f(t) 
if t(k) < 0; f(k) = 0; else f(k) = t(k); end; 
if t(k) < -pi; f(k) = t(k) + 2*pi; end; 
if t(k) > pi ; f(k) = 0; end; 
end 


Kh ct 
ou 


^ initialize Fourier series with the mean term 
fs = (pi/4) * ones(size(t)); 
clf % clear any figures 
for n = 1:6 
^4 create plot of truncated FS with only n harmonic 
fs = fs - (2/pi) * cos((2*n-1)*t) / (2*n-1)^2; 
fs = fs - (-1)^n * sin(n*t) / n; 
subplot(3,2,n), plot(t,fs,t,f,’--’) 
if n== 
legend(?mean plus 1 term’,’f(t)’); legend boxoff; 
else 
legend([?^mean plus ?,num2str(n),? terms’],’f(t)’) 
legend boxoff 
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end 

if n >= 5; xlabel(’t’); end; 
end 
As the figure shows, successive corrections are made to the mean value of the series, 7/2. 
As each harmonic is added, the Fourier series fits the function better in the sense of least 
squares: 


T4-2L 
| f(x) — fw (x)? dz = minimum, (5.1.14) 


where fy (x) is the truncated Fourier series of N terms. Still, near the points of discontinuity 
t = +7, the Fourier series struggles to express a discontinuity as a sum of continuous 
sinusoidal functions. Failing to do so, it oscillates above and below the given function. 
Indeed, even if we could actually compute the series with an infinite number of harmonics, 
we would still obtain incorrect answers near the discontinuities. We will discuss this Gibbs 
phenomena at the end of Section 5.2. 


e Example 5.1.2 


Let us calculate the Fourier series of the function f(t) = |t|, which is defined over the 
range -Tn <t <7. 
From the definition of the Fourier coefficients, 


1 p T T T 
=.= —tdt tdt} =- +- = 5.1.1 
ao 3l +f ai p T, ( 5) 


T 


An = 2 n —tcos(nt) dt + ] testen a| (5.1.16) 


T =T 


amt sin(nt) + cos(nt) |° | nt sin(nt) + cos(nt) |" (5.1.17) 
ner a nT N 
2 
= 5 [(-1” - 1] (5.1.18) 
nen 
and 
1 0 T 
bn = — J —tsin(nt) dt «f t sin(nt) a| (5.1.19) 
T -T 0 
_ nt cos(nt) — sin(nt) |° nt cos(nt) — sin(nt) |" EN (5.1.20) 
n?m La n? ò 
for n = 1,2,3,.... Therefore, 
T. 2««[(-1)*-— 1] m 4 «& cos[(2m — 1)t] 
= t) = 1.21 
it 2 X QE n? eon d 2 m X (2m — 1)? (5 ) 


for -r Xt&m. 
In Figure 5.1.2 we show how well Equation 5.1.21 approximates the function by graph- 
ing various partial sums of this expansion. As the figure shows, the Fourier series does very 
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4 4 
—— mean plus 1 term — mean plus 2 terms 
aw n sel RB) ^ 3f A~ oce 
2 2 
1 1 
0 0 
-4 -2 0 2 4 -4 -2 0 2 4 
4 4 
— mean plus 3 terms — mean plus 4 terms 
3 = - f(t) 3 sse 
2 2 
1 1 
0 0 
-4 -2 0 2 4 -4 -2 0 2 4 
4 4 
— mean plus 5 terms — mean plus 6 terms 
3 - - fit) 3 = Sit) 
2 2 
1 1 
0 0 
-4 -2 0 2 4 -4 -2 0 2 4 
t t 
Figure 5.1.2: Partial sum of the Fourier series for f(t) = |t]. 


well even when we use very few terms. The reason for this rapid convergence is the nature 
of the function: it does not possess any jump discontinuities. 


e Example 5.1.3 


Sometimes the function f(t) is an even or odd function.? Can we use this property to 
simplify our work? The answer is yes. 
Let f(t) be an even function. Then 


L L 
if, f(t) dt = i f(t) at, (5.1.22) 


On = AA f(t) cos( 57) ar = 2f f(t) )cos( 2t) dt, (5.1.23) 
-if.« f(t) )sin( 2 t) dt =0. (5.1.24) 


Here we used the properties that yeu fe(x) dz = zje fe(x) dx and Js Lfo(z)dz = 0. Thus, 
if we have an even function, we merely ne ao and an via Equation 5.1. » and Equation 
5.1.23, and bn = 0. Because the corresponding series contains only cosine terms, it is often 
called a Fourier cosine series. 


and 


whereas 


5 An even function fe(t) has the property that fe(—t) = fe(t); an odd function fo(t) has the property 
that fo(—t) = —fo(t). 
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Similarly, if f(t) is odd, then 


"ES t 
ao = an = 0, and b, = if f(t) sin( ^.) dt. (5.1.25) 
L Jo L 


Thus, if we have an odd function, we merely compute b, via Equation 5.1.25 and ag = an = 
0. Because the corresponding series contains only sine terms, it is often called a Fourier 
sine series. 


e Example 5.1.4 


In the case when f(x) consists of a constant and/or trigonometric functions, it is much 
easier to find the corresponding Fourier series by inspection rather than by using Equation 
5.1.6. For example, let us find the Fourier series for f(x) = sin? (x) defined over the range 
-T «X gq «m. 

We begin by rewriting f(x) = sin?(z) as f(x) = z[1— cos(2x)]. Next, we note that any 
function defined over the range —7 < x < 7 has the Fourier series 


a 
f(x) = ae D an cos(nx) + bn sin(nz) (5.1.26) 
= > + a cos(x) + bı sin(x) + az cos(2x) + bo sin(2x) +++. (5.1.27) 
On the other hand, 
f(x) = § — $cos(2x) = j + 0cos(x) + Osin(z) — 3 cos(2x) + Osin(2x) +--+. (5.1.28) 


By inspection, we can immediately write that 
ag = 1, Q1 = bi = 0, a2 = —t, bg = 0, Aan = b, = 0, n > 3. (5.1.29) 


Thus, instead of the usual expansion involving an infinite number of sine and cosine terms, 
our Fourier series contains only two terms and is simply 


f(x) = $ — $ cos(2z), -T Suc. (5.1.30) 


e Example 5.1.5: Quieting snow tires 


An application of Fourier series to a problem in industry occurred several years ago, 
when drivers found that snow tires produced a loud whine® on dry pavement. Tire sounds 
are produced primarily by the dynamic interaction of the tread elements with the road 
surface.’ As each tread element passes through the contact patch, it contributes a pulse of 
acoustic energy to the total sound field radiated by the tire. 


6 See Varterasian, J. H., 1969: Math quiets rotating machines. SAE J., 77(10), 53. 


7 Willett, P. R., 1975: Tire tread pattern sound generation. Tire Sci. Tech., 3, 252-266. 
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Figure 5.1.3: Temporal spacing (over two periods) and frequency spectrum of uniformly spaced snow tire 
treads. 


For evenly spaced treads we envision that the release of acoustic energy resembles the 
top of Figure 5.1.3. If we perform a Fourier analysis of this distribution, we find that 


1 —m/24€ m/2--e 4 
dus / ies f ide (5.1.31) 
T —m/2—e m/2—e T 
where e is half of the width of the tread and 
1 —m/2--e n/2+e 
an = — / cos(nt) dt «f cos(nt) dt (5.1.32) 
T —m/2—e m/2—«e 
Ec 1 —mn/24€ k n/2+e 
mr E (nt)| geo sin(nt) 255 (5.1.33) 
1 
= sin | 5 + ne) sin( c ne) | sin(7 +ne) sin( ne) (5.1.34) 
nT 2 2 2 
1 4 nn. 
= — È o + 2cos( 2 a) sin(ne) = — cos( 2) sin(ne). (5.1.35) 
nT 2 2 nc 2 


Because f(t) is an even function, b, = 0. 

The question now arises of how to best illustrate our Fourier coefficients. In Section 5.4 
we will show that any harmonic can be represented as a single wave A, cos(nmt/ L + pn) or 
A, sin(nat/L + Yn), where the amplitude An = J/a2 + 02. In the bottom frame of Figure 
5.1.3, MATLAB was used to plot this amplitude, usually called the amplitude or frequency 
spectrum $ 4/a2 + b2, as a function of n for an arbitrarily chosen e = 7/12. Although the 
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value of e will affect the exact shape of the spectrum, the qualitative arguments that we 
1 


will present remain unchanged. We have added the factor 5 so that our definition of the 
frequency spectrum is consistent with that for a complex Fourier series stated after Equation 
5.5.12. The amplitude spectrum in Figure 5.1.3 shows that the spectrum for periodically 
placed tire treads has its largest amplitude at small n. This produces one loud tone plus 
strong harmonic overtones because the fundamental and its overtones are the dominant 
terms in the Fourier series representation. 

Clearly, this loud, monotone whine is undesirable. How might we avoid it? Just as 
soldiers marching in step produce a loud uniform sound, we suspect that our uniform tread 
pattern is the problem. Therefore, let us now vary the interval between the treads so that 
the distance between any tread and its nearest neighbor is not equal, as illustrated in Figure 


5.1.4. Again we perform its Fourier analysis and obtain that 


—mn/24€ m/A--e 
oat | [af rar x (5.1.36) 
» T 


T —m/2—e /4—€ 


1 —mn/24€ m/A--e 
m=- / cos(nt) dt «f cos(nt) dt (5.1.37) 


—1/2-€ m/A4—e 
—mn/24€ 1 m/A--e 
— — sin(nt) + — sin(nt) (5.1.38) 
us —mn/2—«e TU m/A—e 
1 nt 1 . (NT .fnm 
= [sin( ne) sin( + ne) | [sin( + ne) sin( ne) (5.1.39) 
NT T 4 4 
2 NT nT ; 
an = — [cos ( 7.) + cos(“*)] sin(ne), (5.1.40) 
nt 2 4 
and 
1 —m/2--e m/A--e 
b, = — J sin(nt) a+ [ sin(nt) dt (5.1.41) 
T —mn/2—e m/A4—e 
=~ sg mE on) ces CR e] - Ze CE tne) m CT - neam 
E cos 5 ne cos 7 ne e cos A + ne cos 1 ne)\(5.1. 
= og CT) S CT) J seo (5.1.43) 
B sin 1 sin 5 sin(ne). 1. 


The MATLAB script is: 


epsilon = pi/12; % set up parameter for fs coefficient 
n = 1:20; % number of harmonics 

argi = (pi/2)*n; arg2 = (pi/4)*n; arg3 = epsilon*n; 
^4 compute the Fourier coefficient an 

an = (cos(argi) + cos(arg2)).*sin(arg3); 

an = (2/pi) * an./n; 

^4 compute the Fourier coefficient bu 

bn = (sin(arg2) - sin(argi)).*sin(arg3); 

bn = (2/pi) * bn./n; 

^4 compute the magnitude 

cn = 0.5 * sqrt(an.*an + bn.*bn); 
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Figure 5.1.4: Temporal spacing and frequency spectrum of nonuniformly spaced snow tire treads. 


^4 add in the a0 term 

cn = [2*epsilon/pi,cn]; 

n = [0,nl; 

clf ^ clear any figures 

axes(’FontSize’,20) % set font size 

stem(n,cn,’filled’) % plot spectrum 

set (gca,’PlotBoxAspectRatio’,[8 4 1]) % set aspect ratio 
xlabel(’n’) % label x-axis 

ylabel(’?( a ^2 + bon^2 )*{1/2}/2’) % label y-axis, 


was used to compute the amplitude of each harmonic as a function of n and the results 
were plotted. See Figure 5.1.4. The important point is that our new choice for the spacing 
of the treads has reduced or eliminated some of the harmonics compared to the case of 
equally spaced treads. On the negative side, we have excited some of the harmonics that 
were previously absent. However, the net effect is advantageous because the treads produce 
less noise at more frequencies rather than a lot of noise at a few select frequencies. 

If we were to extend this technique so that the treads occurred at completely random 
positions, then the treads would produce very little noise at many frequencies and the total 
noise would be comparable to that generated by other sources within the car. To find the 
distribution of treads with the whitest noise? is a process of trial and error. Assuming 
a distribution, we can perform a Fourier analysis to obtain its frequency spectrum. If 
annoying peaks are present in the spectrum, we can then adjust the elements in the tread 


8 White noise is sound that is analogous to white light in that it is uniformly distributed throughout 
the complete audible sound spectrum. 
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distribution that may contribute to the peak and analyze the revised distribution. You are 


finished when no peaks appear. 


Problems 


Find the Fourier series for the following functions. Using MATLAB, plot the Fourier spec- 
trum. Then plot various partial sums and compare them against the exact function. 


—m«t«0 
0ct«m 


0, -Tr <t<0 
5. ft—4 t O0<t<7/2 
m—t, TJ2Lt<T 
7. od ee. -L«t«L 
0, -r<t<0 
3 focus 0ztzm 


15. f(t) =sinh[a (7/2 — t), n X t€ v 


17. Given the Fourier series 


ne 


f(x) = 5 sae) sin(nma), 


t; -r <t<0 
: (0-15 0xt«m 
_fij2+t,  -1xtx0 
ice rs Ds 
0, —r <t < —mn[2 
6. f(t) 2 4 sin(2t), —1/2x t € 7/2 
0, m/2xtxm 
8. f(t) 2t - £2, -L«t«L 
t -i<t<i 
10. #9 = { ae 
lt Ses 
0, —7<t<0 
2.1) ={ 2 0xt«m 


14. f(t) = tcos(at/L), -L «t«L 


t(2L — t), O<tŁ<2L 
16. f(t) = 
t? —6Lt+8L?, 2b<t<4L 
0<zr<l, 


use MATLAB to plot this Fourier series for E «a «2asathree-dimensional plot with axes 
x, f(x) and a. What happens as a crosses the line a = 1? 


Project: Design Your Own Snow Tire, Part I 


In the example on quieting snow tires, there are at least three important parameters: 
the thickness of the tread 2e, the time at which the first tread hits the road t — —a, and the 
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time at which the second thread hits the road t = b, where e < a,b < v — e. The values that 
I used were arbitrary. In this project you will redo the calculations to see the sensitivity of 
the results various values of a, b and e. 


Step 1: Recompute the Fourier coefficients where one of the treads strikes the road between 
à — e and —a + € and the second strikes the road between b — e and b + e. What is the 
effect of a thicker tread on the spectrum? 


Step 2: In the text we examined the case of a = —7/2 and b = 7/4. What happens if 
a = —37/2 and b = 7/4? Explain your results. 


Step 3: What happens to the spectrum when the distance between the treads lies at some 
other arbitrary distance between 0 and 7? 


5.2 PROPERTIES OF FOURIER SERIES 


In the previous section we introduced the Fourier series and showed how to compute 
one given the function f(t). In this section we examine some particular properties of these 
series. 


| Differentiation of a Fourier series 


In certain instances we only have the Fourier series representation of a function f(t). 
Can we find the derivative or the integral of f(t) merely by differentiating or integrating the 
Fourier series term by term? Is this permitted? Let us consider the case of differentiation 
first. 

Consider a function f(t) of period 2L, which has the derivative f'(t). Let us assume 
that we can expand f'(t) as a Fourier series. This implies that f'(t) is continuous except 
for a finite number of discontinuities and f(t) is continuous over an interval that starts at 
t = T and ends at t = 7 + 2L. Then 


0 XS t t 
f't)- 2 + » cos( 27t) +b, sin( ^) . (5.2.1) 


where we denoted the Fourier coefficients of f'(t) with a prime. Computing the Fourier 
coefficients, 
1 


j T+2L ; 1 
=r f f'(t)dt = = [f(r + 2) — f(7)] = 0, (5.2.2) 


if f(T + 2L) = f(r). Similarly, by integrating by parts, 


-Af re t) cos( 22) dt (5.2.3) 
de 


= MI A 


T+2L T+2L 
(0) cos (T 3] + af f(t) sin( “) dt (5.2.4) 


= (5.2.5) 


Fourier Series 203 


and 
T42L 
uz zJ f(t) sS) dt (5.2.6) 
T+2L T+2L 
= 1 i 16:3] s T fü) cos( 27t) dt (5.2.7) 
DT s 
=.=. (5.2.8) 


If we have a function f(t) whose derivative f’(t) is continuous except for a finite number of 
discontinuities and f(T) = f(T + 2L), then 


'(t) = 2 » p cos( 22t) — an 26:3] (5.2.9) 


That is, the derivative of f(t) is given by a term-by-term differentiation of the Fourier series 


of f (t). 
e Example 5.2.1 


'The Fourier series for the periodic function 


0, -r «€ t € 0, 
f(t- f t, 0<t<7/2, f(t) = f(t 4- 2n), (5.2.10) 

T-t, n/2xtxm, 

is -" 
f(t) = : 23 nd eL m [UE 5 sin[2n — 1)t]. (5.2.11) 


Because f(t) is continuous over the entire interval (—7,7) and f(—7) = f(t) = 0, we can 
find f'(t) by taking the derivative of Equation 5.2.11 term by term: 


oo 


sin[2(2n — 1)t] 
X a p- z7 s[n - 11. (5.2.12) 
This is the same Fourier series that we would obtain by computing the Fourier series for 
0, —m«t«0, 
d bm | 1, 0<t< 27/2, (5.2.13) 
—1, m/2«t«m. 


| Integration of a Fourier series 


To determine whether we can find the integral of f(t) by term-by-term integration of 
its Fourier series, consider a form of the antiderivative of f(t): 


F(t) = f(r) - 2] ar. (5.2.14) 
A 2 


204 Advanced Engineering Mathematics with MATLAB 


Now 
F(t+2L) = 4 lie = 2 ex lie = 2 dr (5.2.15) 
L 
d [/m - =| dr (5.2.16) 
orf f(r) dr — Lag = F(t), (5.2.17) 


so that F(t) has a period of 2L. As a result we may expand F(t) as the Fourier series 


eA. cos (ST t) 4B, sa( 27), (5.2.18) 


For An, 
1 Ti 
A - if. t) cos( 7 ) dt (5.2.19) 
1 jm (nat/L) ae tag ao] . [nat 
t)— —Ss S t 5.2.20 
E nt /D S =f [ro 7 | sin L d ( ) 
= : .2.21 
E e ) 
Similarly, 
an 
= y .2.22 
Bn nw /L e ) 
Therefore, 
= “ot Ao | «^ ansin(nat/L) — b, cos(nmt/L) 
= .2.23 
[1o I(r 2 2 nt /L $ ) 


This is identical to a term-by-term integration of the Fourier series for f(t). Thus, we can 
always find the integral of f(t) by a term-by-term integration of its Fourier series. 


e Example 5.2.2 


The Fourier series for f(t) = t for —r < t < 7 is 


oat 


sin(nt). (5.2.24) 


To find the Fourier series for f(t) = t?, we integrate Equation 5.2.24 term by term and find 


that 
2t 


= Sys E 
2 0 n=1 


cos(nt) (5.2.25) 


Fourier Series 205 


But $77 ,(—1)"/n? = —4?/12. Substituting and multiplying by 2, we obtain the final 
result that 


cos(nt). (5.2.26) 


| Parseval’s equality 


One of the fundamental quantities in engineering is power. The power content of a 
periodic signal f(t) of period 2L is AN f? (t) dt/ L. This mathematical definition mirrors 
the power dissipation I?R that occurs in a resistor of resistance R where I is the root mean 
square (RMS) of the current. We would like to compute this power content as simply as 
possible given the coefficients of its Fourier series. 

Assume that f(t) has the Fourier series 


f(t) = > 5307 cos( 575) + br sin( 27t) (5.2.27) 


Then, 


T--2L 
+> =| f(t) sS) dt (5.2.28) 


=2 +Y (a2 +02). (5.2.29) 


Equation 5.2.29 is Parseval’s equality.? It allows us to sum squares of Fourier coefficients 
(which we have already computed) rather than performing the integration jo f? (t) dt 
analytically or numerically. 


e Example 5.2.3 


The Fourier series for f(t) = t? over the interval [—7, 7] is 


cos(nt). (5.2.30) 


9 Parseval, M.-A., 1805: Mémoire sur les séries et sur l'intégration compléte d'une équation aux dif- 
férences partielles linéaires du second ordre, à coefficients constants. Mémoires présentés a l'Institut des 
sciences, lettres et arts, par divers savans, et lus dans ses assemblées: Sciences mathématiques et Physiques, 
1, 638-648. 
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'Then, by Parseval's equality, 


tf? 2t°|" 4ni E d: 2 4 : 
E tdt = = r1 we pate = 5.2.31 
s z|, 18 2s nn O (5 JE 23 a ) 
Consequently, 
Tt E | 
— = = .2.32 
A EI (5.2.32) 


| Gibbs phenomena 


In the actual application of Fourier series, we cannot sum an infinite number of terms 
but must be content with N terms. If we denote this partial sum of the Fourier series by 
Sn (t), we have from the definition of the Fourier series: 


N 
Sy (t) = $40 + Xan cos(nt) + bn sin(nt) (5.2.33) 
n=1 
1 2n 1 27 N 
E f(x) dz + — f(x) p cos(nt) cos(nz) + sin(nt) sin(nz)| dx (5.2.34) 
7 Jo T Jo = 


] f” i 
2 ro ds eres an] dx (5.2.35) 


] 95 7 sin[(N + 4)(x — t)] 
sin[5 (x — t)] 


zl da. (5.2.36) 


The quantity sin[(N + 4)(x — t)]/ sin[4 (x — t)] is called a scanning function. Over the range 
0 < x € 2m it has a very large peak at x = t where the amplitude equals 2N + 1. See Figure 
5.2.1. On either side of this peak there are oscillations that decrease rapidly with distance 
from the peak. As N — oo, the scanning function becomes essentially a long narrow slit 
corresponding to the area under the large peak at z — t. If we neglect for the moment the 
small area under the minor ripples adjacent to this slit, then the integral, Equation 5.2.36, 
essentially equals f(t) times the area of the slit divided by 27. If 1/27 times the area of the 
slit equals unity, then the value of Syn (t) ~ f(t) to a good approximation for large N. 

For relatively small values of N, the scanning function deviates considerably from its 
ideal form, and the partial sum Sy(t) only crudely approximates f(t). As the partial sum 
includes more terms and N becomes relatively large, the form of the scanning function 
improves and so does the agreement between S(t) and f(t). The improvement in the 
scanning function is due to the large hump becoming taller and narrower. At the same time, 
the adjacent ripples become more numerous as well as narrower in the same proportion as 
the large hump does. 

The reason why Sy (t) and f(t) will never become identical, even in the limit of N — oo, 
is the presence of the positive and negative side lobes near the large peak. Because 


N 
— 1-4 2 cos[n(t — x)], (5.2.37) 


n=1 


sin[(N + $)(x — tj] 
sin[4 (x — t)] 
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scanning function 


EX wx y 
WEE CNET. 


0.00 1.26 2.52 3.78 5.04 6.30 
x 


Figure 5.2.1: The scanning function over 0 < x < 2r for N = 5. 


an integration of the scanning function over the interval 0 to 27 shows that the total area 
under the scanning function equals 27. However, from Figure 5.2.1 the net area contributed 
by the ripples is numerically negative so that the area under the large peak must exceed 27 
if the total area equals 27. Although the exact value depends upon N, it is important to 
note that this excess does not become zero as N — oo. 

Thus, the presence of these negative side lobes explains the departure of our scanning 
function from the idealized slit of area 27. To illustrate this departure, consider the function: 


I = l un m (5.2.38) 
Then, 
_ 1 (^ sin((N + 3)(z — £) 1 f” sin[(N + 3)(z — t)] 
Sn(t) 21 sin[i(« — £) d x sin[EG - 5] dr (5.2.39) 
_ 1 (7 {snl + 3)(z — 0] ,. | snl  3)(z +9) 
x] | sin[3 (x — t)] cet sin[3 (a + t)] : \ (52:40) 
I. nt sin|(N + 3)0] 1 m sin(N + 198] 
2n À ag). De f ao (5.2.41) 


The first integral in Equation 5.2.41 gives the contribution to S(t) from the jump dis- 
continuity at t = 0 while the second integral gives the contribution from t = m. In Figure 
5.2.2 we have plotted Sy(t) when N = 27 and N = 81. Residual discrepancies remain 
even for very large values of N. Indeed, as N increases, this figure changes only in that 
the ripples in the vicinity of the discontinuity of f(t) proportionally increase their rate of 
oscillation as a function of t while their relative magnitude remains the same. As N — oo 
these ripples compress into a single vertical line at the point of discontinuity. True, these 
oscillations occupy smaller and smaller spaces but they still remain. Thus, we can never 
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Figure 5.2.2: The finite Fourier series representation Sy (t) for the function, Equation 5.2.38, for the range 
-1<t<7 for N = 27 and N = 8l. 


approximate a function in the vicinity of a discontinuity by a finite Fourier series without 
suffering from this over- and undershooting of the series. This peculiarity of Fourier series 
is called the Gibbs phenomena.!? Gibbs phenomena can only be eliminated by removing 
the discontinuity.!! 


Problems 


Additional Fourier series representations can be generated by differentiating or integrating 
known Fourier series. Work out the following two examples. 


1. Given 
nm? 2:43 A cos|[(2n + 1)z] 
eS E O0<a< 
x. TERS 
obtain 
me—ne? < sin[(2n + 1)z] 
————-— ————————— <a< 
8 2 Qn ' PSIS 


by term-by-term integration. Could we go the other way, i.e., take the derivative of the 
second equation to obtain the first? Explain. 


2. Given 


r? — 30? cos(nx) 
EM n+l < < 
Be = al, aco, 


10 Gibbs, J. W., 1898: Fourier’s series. Nature, 59, 200; Gibbs, J. W., 1899: Fourier’s series. Nature, 
59, 606. For the historical development, see Hewitt, E., and R. E. Hewitt, 1979: The Gibbs-Wilbraham 
phenomenon: An episode in Fourier analysis. Arch. Hist. Exact Sci., 21, 129-160. 


11 For a particularly clever method for improving the convergence of a trigonometric series, see Kan- 
torovich, L. V., and V. I. Krylov, 1964: Approximate Methods of Higher Analysis. Interscience, pp. 77-88. 
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obtain 
2 


m?y — 49 — ,sin(nz) 
—— =) ( 1)" a TARS T 
n=1 


12 


by term-by-term integration. Could we go the other way, i.e., take the derivative of the 
second equation to obtain the first? Explain. 


3. Consider the function 


with f(x +27) = f(x). 


(a) Find the Fourier series for f(x) and show that 


(b) Because 


(c) Using the results from part (a), integrate it term-by-term and show that you obtain part 


4. Consider the function 


with f(x +27) = f(z). 


(a) Find the Fourier series for f(x) and show that 


f(x) = or »» E cos(nx) — E sin(nzx). 
n=1 
(b) Because 
da me-bl3» ^ VS 


show that Fourier series for g(x) is 
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(c) Using the results from part (a), integrate it term-by-term and show that you obtain part 
b). 


5. Consider the function f(x) = |x|, C1 < x < 1, with f(x +1) = f(x). 


(a) Find the Fourier series for f(r) and show that 


f(x) = ; + E 5 C : cos(nmz). 


(b) Because 


z i-z?/2, -l<2<0, 
g(z)—- | f(tj)dt= 
zi 1 22/2, 0czx1, 


show that the Fourier series for g(x) is 


g(2)=5+>. 


iA 
n=1 


sin(nzz). 


1"-—1 1)” 
uei cm 


T? nT 
(c) Using the results from part (a), integrate it term-by-term and show that you obtain part 
b). 


6. Consider the function f(x) 214-z,—1 < x € 1, with f(x +1) = f(z). 
(a) Find the Fourier series for f(r) and show that 


oo 
1-2" 
n=1 


Ne 


N 


sin(nre). 


(b) Because 
= f roe- cv 


show that the Fourier series for g(x) is 


2,2 (-1)" DE 
g= E a z2 osam) — 2) 07 


~= 


sin(nzz). 


(c) Using the results from part (a), integrate it term-by-term and show that you obtain part 
b). 


T. (a) Show that the Fourier series for the odd function: 


ciu —2<t<0, 2482 1 yin OD 


2t — £?, 0<t<2, MO = 2. 
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(b) Use Parseval's equality to show that 
nê = 1 
960 = 24 Gn 1) 


This series converges very rapidly to 7°/960 and provides a convenient method for comput- 
; 6 
ing 7°. 


5.3 HALF-RANGE EXPANSIONS 


In certain applications, we will find that we need a Fourier series representation for 
a function f(x) that applies over the interval (0, L) rather than (—L, L). Because we are 
completely free to define the function over the interval (— L, 0), it is simplest to have a series 
that consists only of sines or cosines. In this section we shall show how we can obtain these 
so-called half-range expansions. 

Recall in Example 5.1.3 how we saw that if f(x) is an even function, then bn = 0 for all 
n. Similarly, if f(x) is an odd function, then a9 = an = 0 for all n. We now use these results 
to find a Fourier half-range expansion by extending the function defined over the interval 
(0, L) as either an even or odd function into the interval (—L,0). If we extend f(x) as an 
even function, we will get a half-range cosine series; if we extend f(x) as an odd function, 
we obtain a half-range sine series. 

It is important to remember that half-range expansions are a special case of the general 
Fourier series. For any f(x) we can construct either a Fourier sine or cosine series over the 
interval (—L, L). Both of these series will give the correct answer over the interval of (0, L). 
Which one we choose to use depends upon whether we wish to deal with a cosine or sine 
series. 


e Example 5.3.1 
Let us find the half-range sine expansion of 
f(x) =1, 0cc«. (5.3.1) 


We begin by defining the periodic odd function 


~ —1, —m <x<0, 
f9-1 EUR (5.3.2) 


with f(z--2-)-— f(x). Because f(x) is odd, ao = an = 0 and 


27 fs. 2 T 2 2 
b, = =| Lsin(na) dx = —~-cos(nat) 9 pm [cos(nz) — 1] = ME [((—1)* — 1]. 
(5.3.3) 
The Fourier half-range sine series expansion of f(x) is therefore 
2 & [1 - (-1)"] . 4 S sin[(2m — 1)z] 
= = : 5.3.4 
C col aw jer y ul. (5.3.4) 
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Figure 5.3.1: Partial sum of N terms in the Fourier half-range sine representation of a square wave. 


As a counterpoint, let us find the half-range cosine expansion of f(x) — 1, 0 € z « s. 
Now, we have that b, — 0, 


2 T 
a == f ldx = 2, (5.3.5) 
T Jo 
and 
- 2 [ext Nie uut 0 (5.3.6) 
B= Gy URN x = ——sin(nx)|, = 0. 3. 


Thus, the Fourier half-range cosine expansion equals the single term: 
f(x) =1, O<a<n. (5.3.7) 


This is perfectly reasonable. To form a half-range cosine expansion we extend f(x) as 
an even function into the interval (—7,0). In this case, we would obtain f(z) = 1 for 
—r <a «m. Finally, we note that the Fourier series of a constant is simply that constant. 
In practice it is impossible to sum Equation 5.3.4 exactly and we actually sum only 
the first N terms. Figure 5.3.1 illustrates f(x) when this Fourier series contains N terms. 
As seen from the figure, the truncated series tries to achieve the infinite slope at x = 0, but 
in the attempt, it overshoots the discontinuity by a certain amount (in this particular case, 
by 17.9%). This is another example of the Gibbs phenomena. Increasing the number of 
terms does not remove this peculiarity, even if we could take an infinite number of terms; 
it merely shifts it nearer to the discontinuity. 


e Example 5.3.2: Inertial supercharging of an engine 


An important aspect of designing any gasoline engine involves the motion of the fuel, 
air, and exhaust gas mixture through the engine. Ordinarily, an engineer would consider 
the motion as steady flow; but in the case of a four-stroke, single-cylinder gasoline engine, 
the closing of the intake valve interrupts the steady flow of the gasoline-air mixture for 
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nearly three quarters of the engine cycle. This periodic interruption sets up standing waves 
in the intake pipe—waves that can build up an appreciable pressure amplitude just outside 
the input value. 

When one of the harmonics of the engine frequency equals one of the resonance fre- 
quencies of the intake pipe, then the pressure fluctuations at the valve will be large. If the 
intake valve closes during that portion of the cycle when the pressure is less than average, 
then the waves will reduce the power output. However, if the intake valve closes when the 
pressure is greater than atmospheric, then the waves will have a supercharging effect and 
will produce an increase of power. This effect is called inertia supercharging. 

While studying this problem, Morse et al.!? found it necessary to express the velocity 
of the air-gas mixture in the valve, given by 


0, =r < wt < —m/4, 
f(t) = 4 mcos(Qut) /2, —m/4 < wt < 7/4, (5.3.8) 
0, TJA « wt « m, 


in terms of a Fourier expansion. The advantage of working with the Fourier series rather 
than the function itself lies in the ability to write the velocity as a periodic forcing function 
that highlights the various harmonics that might resonate with the structure comprising 
the fuel line. 

Clearly f(t) is an even function and its Fourier representation will be a cosine series. 
In this problem, 7 = —7/w, and L = m/w. Therefore, 


m / Aw 


2 T UW 
a = 2 Z cos(2wt) dt = 4 sin(2wt)|/ — 1, (5.3.9) 
T J—m/Aw Pme 
and 
2 m / Aw t 
üp = = a cos(2wt) cos( 27) dt (5.3.10) 
T J—m«[/Aw m/w 
w m / Aw 
-5 / {cos|(n + 2)wt] + cos[(n — 2)ut]) dt (5.3.11) 
—m/ Aw 
jaaa | sm(n-2un| ^ 
sin|(n+2)wt i sin|(n—2)wt 
2(n42) T — 2(n-3) , n72, 
= a TAN (5.3.12) 
wt + sin Cort) n=2, 
—m/Aw 
LL nu 2 
= n sea i) nr (5.3.13) 
4? n= 2: 


Plotting these Fourier coefficients using the MATLAB script: 
for m = 1:21; 
n = m-1; % compute the indices for the harmonic 
^4 compute the Fourier coefficients an 
if n == 2; an(m) = pi/4; else; 


12 Morse, P. M., R. H. Boden, and H. Schecter, 1938: Acoustic vibrations and internal combustion engine 
performance. I. Standing waves in the intake pipe system. J. Appl. Phys., 9, 16-23. 
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Figure 5.3.2: The spectral coefficients of the Fourier cosine series of the function given by Equation 5.3.9. 


an(m) = 4.*cos(pi*n/A4)/(4-n*n); end; 
end 
nn-0:20; % create indices for x-axis 
fzero-zeros(size(nn)); % create the zero line 
clf % clear any figures 
axes(?FontSize?,20) % set font size 
stem(nn,an,? filled?) % plot spectrum 
hold on 
plot(nn,fzero,?-?) % plot the zero line 
set (gca,’PlotBoxAspectRatio’,[8 4 1]) % set aspect ratio 
xlabel(’n’) % label x-axis 


ylabel(’an’) % label y-axis, 


we see that these Fourier coefficients become small rapidly (see Figure 5.3.2). For that 
reason, Morse et al. showed that there are only about three resonances where the acoustic 
properties of the intake pipe can enhance engine performance. These peaks occur when 
q = 30c/NL = 3,4, or 5, where c is the velocity of sound in the air-gas mixture, L is the 
effective length of the intake pipe, and N is the engine speed in rpm. See Figure 5.3.3. 
Subsequent experiments!’ verified these results. 

Such analyses are valuable to automotive engineers. Engineers are always seeking ways 
to optimize a system with little or no additional cost. Our analysis shows that by tuning 
the length of the intake pipe so that it falls on one of the resonance peaks, we could obtain 
higher performance from the engine with little or no extra work. Of course, the problem is 
that no car always performs at some optimal condition. 


Problems 


Find the Fourier cosine and sine series for the following functions. Then, use MATLAB to 
plot the Fourier coefficients. 


1. f(t) =t, O0<t<a7 2. f(t) 2 7—t, 0ct«m 


3. f(t) = t(a — t), Off <u A T) = e*t, 0ct«a 


13 Boden, R. H., and H. Schecter, 1944: Dynamics of the inlet system of a four-stroke engine. NACA 
Tech. Note 935. 
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1220 RPM. 
2,56" diam. 


Figure 5.3.3: Experimental verification of inertial supercharging within a gasoline engine resulting from 
the resonance of the air-gas mixture and the intake pipe system. The peaks correspond to the n = 3,4, 
and 5 harmonics of the Fourier representation, Equation 5.3.13, and the parameter q is defined in the text. 


(From Morse, P., R. H. Boden, and H. Schecter, 1938: Acoustic vibrations and internal combustion engine 
performance. J. Appl. Phys., 9, 17 with permission.) 


t, 0<t<i t, O<t<l 
5. F(t) = M. 6.0 = 4 
1-t, $<t<l 1, ist«2 
0, O<t<- 
7. fA =r? -t, Otter 8. f(t) = a 
l, z«t«a 
2 
0 o<t<f 0 0<t<5 
: 38 
[n a 2a du 3a 
024t-4 «tx 10. f= 4 1, ene E 
9. f(t) g^ ge ES ] 4 
[n 2a q 
— <t 
S z atx 0, 1 <t<a 
2t 
l 0<t< ue olia 
219 2° 2 — 
11. f(t) = WT 12. f(t) Ba-2 a... 
2 = a 
E mE T MED 
t, TES 
—t 
13. f(t) = 14. f =, 0<t<a 
u cse . 
24^ 395 
15. Using the relationships!^ that 
af u v 
2 
à SEE, dz = F Jala), and f (=a?) costas) de = XT (ZE) T(v + 3) J (au), 


14 Gradshteyn, I. S., and I. M. Ryzhik, 1965: Table of Integrals, Series, and Products. Academic Press, 
Section 3.753, Formula 2 and Section 3.771, Formula 8. 
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with a > 0, u > 0,(v) > —2, obtain the following half-range expansions: 


1 


——À ET Jo(nm) cos(nna), 0<a<1, 
Vi- 


and 
[(2n — 1)r/2 
VI-r = 2» as cos(2n — 1)mz/2, | 0«z«l. 
Here J,(-) denotes the Bessel function of the first kind and order v (see Section 11.5) and 
T(-) is the gamma function.!? 


16. The function 


t t? t t 
f£() -1- (1 2)— + (a— D * (a D)-35 -a-5, O<t<n, 


is a curve fit to the observed pressure trace of an explosion wave in the atmosphere. Because 
the observed transmission of atmospheric waves depends on the five-fourths power of the 
frequency, Reed!® had to re-express this curve fit as a Fourier sine series before he could 
use the transmission law. He found that 


f(t) = 1 5 - | id sin(2nt) 
1c 2 2(a—1 48a 
+ E on —1 | ES = i Tin — 1) sin|(2n = 1)t] 


Confirm his result. Figure 5.3.4 illustrates these results for a — 5. 
5.4 FOURIER SERIES WITH PHASE ANGLES 


Sometimes it is desirable to rewrite a general Fourier series as a purely cosine or purely 
sine series with a phase angle. Engineers often speak of some quantity leading or lagging 
another quantity. Re-expressing a Fourier series in terms of amplitude and phase provides 
a convenient method for determining these phase relationships. 

Suppose, for example, that we have a function f(t) of period 2L, given in the interval 
[-L, L], whose Fourier series expansion is 


X E) by s (^). (5.4.1) 


We wish to replace Equation 5.4.1 by the series: 


/() - 2 Y B, sin( 2 n e.) (5.4.2) 
n=1 


15 Gradshteyn and Ryzhik, op. cit., Section 6.41. 


16 Reed, J. W., 1977: Atmospheric attenuation of explosion waves. J. Acoust. Soc. Am., 61, 39-47. 
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Figure 5.3.4: Partial sum of the Fourier sine series given in Problem 16 when a — 5. 


To do this we note that 


B.s nrt 4 nrt Ebs nrt 
nsin| —— + Yn | = an cos| — » Sin| —— 
Bom j is 
: T : nat 
= B,sin| —— | cos(yn) + Bn sin(yn) cos| — |. 
L L 
We equate coefficients of sin(nat/L) and cos(nzt/L) on both sides and obtain 
an = By, sin(Yn), and b, = Bn cos(Yn). 


Hence, upon squaring and adding, 


Bn = ya? + b2, 


while taking the ratio gives 
Pn = tan (an /bn). 


Similarly, we could rewrite Equation 5.4.1 as 


NS unt 
f(t)- 5 PX L te). 


(5.4.3) 


(5.4.4) 


(5.4.5) 


(5.4.6) 


(5.4.7) 


(5.4.8) 
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where 


A, = ya? 402, and Pn = tan! (—5,/a4), (5.4.9) 


and 
an = Án cos(q); and b, = —An sin(Yn). (5.4.10) 


In both cases, we must be careful in computing Yn because there are two possible values of 
Pn that satisfy Equation 5.4.7 or Equation 5.4.9. These angles yn must give the correct an 
and b, using either Equation 5.4.5 or Equation 5.4.10. 

e Example 5.4.1 


The Fourier series for f(t) = e* over the interval -L < t < L is 


pes! : ox aL(-1)" cos( 27t) 


+ 2sinh(aL) » BIB pai L 


- Paina) >> HERCLE s (^). (5.4.11) 


er a2 L2 + n?n? 


Let us rewrite Equation 5.4.11 as a Fourier series with a phase angle. Regardless of whether 
we want the new series to contain cos(nrt/L + pn) or sin(nat/L + pn), the amplitude An 
or Bn is the same in both series: 


2sinh(aL) 


A, = B, = V@ +B = — 5.4.12 
Va L2 + nen ( ) 
If we want our Fourier series to read 
f(t) sinh(aL) + 2sinh(aL) px cos(nmt/ L + pn) (5.4.13) 
mom sinh(a Se A. 
aL Va? L2 + n2 72 

then i 

Pn = tan! (-2) - tan! (27) (5.4.14) 
An aL 


where yn lies in the first quadrant if n is even and in the third quadrant if n is odd. This 
ensures that the sign from the (—1)" is correct. 

Figure 5.4.1 illustrates the amplitudes and phases for Equation 5.4.13 for the case when 
aL = 2. The phase angle was computed using the MATLAB command tan2(-b.n,a.n), 
where an = aL*(-1)An and bn = n*pi*(-l)An. Because we have an amplitude and 
phase for each discrete value of n, these amplitude and phase plots, taken together, are 
called the line specta for our function f(t). 

On the other hand, if we prefer 


sin(nat/L + pn) 


or 5.4.15 
Va? L2 + nen ( ) 


_ sinh(aL) 
f = =a 


+ 2sinh(aL) = 


then 


P L 
Pn = tan”! (2) = — tan”! (=) ; (5.4.16) 
bn n 
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amplitude spectrum 


Figure 5.4.1: The amplitude and phase spectra for the Fourier series given by Equation 5.4.13 with aL — 2. 


where ọn lies in the fourth quadrant if n is odd and in the second quadrant if n is even. 
Again, we could plot the amplitude and phase spectrum for each harmonic. The amplitude 
spectrum is the same as shown in Figure 5.4.1 but the phase spectrum changes to values 
near 7 for n even and slightly less than zero for n odd. Here we computed the phase angle 
using the MATLAB command tan2(a.n,b.n). 


Problems 


For each of the following Fourier series, (1) plot the Fourier series over the specified range, 
(2) write the series in both the cosine and sine phase angle form, and (3) plot both the 
amplitude and phase spectra. 


oo 


8 n : 
a! \ sin[(2n — 1)rt] 
2. f 2m <t<A4 
2* 23 "ped '’ ioi 
3. f i —1)” ,[ Qn - Unt ji goes 
T 2n-1* go jJ* indc 
w= sin(nt), —2r < t € 4n, 
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Figure 5.4.2: The same as Figure 5.4.1 except for the Fourier series given in Problem 7. 


6. f(t) 2 164 3 7 cos( 27t) s D - s ( 2) 4«t«8, 
7. f(t) « : 2 L sin( 7) cos(2nt) : » : [1 cos (7) sin(2nt), -4<t<8, 
8. f(t) = L4 E 2 lan iis 1l eos (272) 2» En CU sin( 77), -2L < x < 4L. 


5.5 COMPLEX FOURIER SERIES 


So far in our discussion, we expressed Fourier series in terms of sines and cosines. We 
are now ready to re-express a Fourier series as a series of complex exponentials. There 
are two reasons for this. First, in certain engineering and scientific applications of Fourier 
series, the expansion of a function in terms of complex exponentials results in coefficients 
of considerable simplicity and clarity. Second, these complex Fourier series point the way 
to the development of the Fourier transform in the next chapter. 

We begin by introducing the variable wn = na/L, where n = 0,+1,+2,... Using 
Euler’s formula we can replace the sine and cosine in the Fourier series by exponentials and 
find that 


f(t) = . 3 y N (git | e ient) d on (cient = a) (5.5.1) 
n=1 


Fourier Series 


_ 90 | 3 an bni lwnt an bni —iwnt 
ope 3r «($43 
If we define c,, — 5 (à — ibn), then 


1 


Ce 5 (à — ibn) 


Similarly, the complex conjugate of cn, c5, equals 


1 T--2L 
* a - iwnt 
Ch = 3 lan + ibn) = val fer’ dt. 


To simplify Equation 5.5.2 we note that 


(—n)r nT 
W-n = " = L = Wn, 
which yields the result that 
Can = A is fie -tdt = ES LE Jorelestgy = 
2L J, 2L J, " 


so that we can write Equation 5.5.2 as 


oo oo 
ao i T. ao i X 
Jc y cup quera tar = T ME X ouf aec ECT 
n=1 


n=1 


Letting n = —m in the second summation on the right side of Equation 5.5.7, 
oo —oo —1 —1 
X c pne nt - 3 Cme mmt ET X c, emt = À c, ei mt, 
n=1 m=—1 m--—oo n--—oo 


T4-2L T+2L F 
= al f (#)[cos(wpt) — i sin(wnt)] dt = xf fede. 


(5.5.5) 


(5.5.6) 


(5.5.7) 


(5.5.8) 


where we introduced m = n into the last summation in Equation 5.5.8. Therefore, 


oo —1 
f(t) = b Y e eint 4 Y c, eit, 
n=1 


n=— Co 


On the other hand, 
ao 1 T+2L a 
92 OL f(t) dt = co = coe," 


because wọ = 07/L = 0. Thus, our final result is 


f(t) = y» Cnet, 


n=— oo 


(5.5.9) 


(5.5.10) 


(5.5.11) 
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where 
] ofr jm (5.5.12) 
n = Ll De '"* dt oO. 
c ar J. f(t)e d 
and n = 0,+1,+2,.... Note that even though c, is generally complex, the summation 


Equation 5.5. T always gives a real-valued function f (t). 

Just as we can represent the function f(t) graphically by a plot of t against f(t), we 
can plot c, as a function of n, commonly called the frequency spectrum. Because c, is 
generally complex, it is necessary to make two plots. Typically the plotted quantities are 
the amplitude spectrum |c,| and the phase spectrum Yn, where pn is the phase of cn. 
However, we could just as well plot the real and imaginary parts of cn. Because n is an 
integer, these plots consist merely of a series of vertical lines representing the ordinates of 
the quantity |c,| or Yn for each n. For this reason we refer to these plots as the line spectra. 


Because 2c, = an — ibn, the coefficients c,, for an even function will be purely real; the 
coefficients c, for an odd function are purely imaginary. It is important to note that we 
lose the advantage of even and odd functions in the sense that we cannot just integrate over 
the interval 0 to L and then double the result. In the present case we have a line integral 
of a complex function along the real axis. 


e Example 5.5.1 


Let us find the complex Fourier series for 


f(t) = { oo (5.5.13) 


which has the periodicity f(t + 27) = f(t). 
With L = 7 and T = —7, wn = nt/L =n. Therefore, 


iod 7 i fe , 
me —1)e™ "t dt + — 1)e ""* dt .5.14 
c bn DE l)e + Se na Je d (5.5.14) 

1 int i 1 int F 

= ad — NL 5.5.15 
2nri 2nri 0 ( ) 
= 1 WT. [MS py 5.5.16 
2NT ( i ) 2NT (e ) ( ) 


if n 4 0. Because e"** = cos(nz) +isin(nm) = (—1)" and e~"™ = cos(—nz) +isin(—n7) = 
(—1)", then 
a 0, n even, 

{ A 5 odd, (5.5.17) 


with 


fc S euet (5.5.18) 
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In this particular problem we must treat the case n — 0 specially because Equation 
5.5.15 is undefined for n — 0. In that case, 


p f° dg 1 0 E io 

= — —1)dt + — 1)dt 2 —(-t —(t)|, — 0. 5.5.19 

ama f CDt f Qdt- z COD, s Ol (5.5.19) 
Because co = 0, we can write the expansion: 

2i o e(2m—1)it 

t) = -— ————— 5.5.20 

Heec I (5.5.20) 

since we can write all odd integers as 2m — 1, where m = 0,+1,+2, +3,.... Using the 


MATLAB script: 


max = 31; % total number of harmonics 

mid = (max*1)/2; % in the array, location of c. 0 

for m = 1:max; 
n =m - mid; % compute value of harmonic 

^4 compute complex Fourier coefficient c.n - (cnr,cni) 
if mod(n,2) == 0; cnr(m) = 0; cni(m) = 0; else; 
cnr(m) = 0; cni(m) = - 2/(pi*n); end; 

end 

nn-(i-mid):(max-mid); % create indices for x-axis 

fzero-zeros(size(nn)); 4 create the zero line 

clf ^4 clear any figures 

amplitude = sqrt(cnr.*cnrtcni.*cni) ; 

phase = atan2(cni,cnr) ; 

% plot amplitude of cn 

subplot (2,1,1), stem(nn, amplitude, ’filled’) 

^4 label amplitude plot 

text (6,0.75,’ amplitude’, ’FontSize’ ,20) 

subplot (2,1,2), stem(nn,phase,’filled’) % plot phases of cn 

text(7,1,’phase’,’FontSize’,20) % label phase plot 

xlabel(’n’,’Fontsize’,20) % label x-axis, 


we plot the amplitude and phase spectra for the function, Equation 5.5.13, as a function of 
n in Figure 5.5.1. 


e Example 5.5.2 
'The concept of Fourier series can be generalized to multivariable functions. Consider 


the function f(x,y) defined over 0 < x < L and 0 < y < H. Taking y constant, we have 
that 


L 
en(y) = ae faye" dz, &=—. (5.5.21) 


Similarly, holding €, constant, 


1 fs ; 
Cnm = af Cn(y)e "m? dy, Nm — —T-. (5.5.22) 
H 0 
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Figure 5.5.1: Amplitude and phase spectra for the function, Equation 5.5.13. 


Therefore, the (complex) Fourier coefficient for the two-dimensional function f(x,y) is 


y np 
o7 rg], ], fla, y)e Vo mmm») de dy, (5.5.23) 


assuming that the integral exists. 
To recover f(x,y) given Cnm, we reverse the process of deriving Cnm. Starting with 


awe. JO cnme™”, (5.5.24) 
we find that a 
fonde X caue. (5.5.25) 
Therefore, 
Foa No. - NC. agp n e (5.5.26) 


T,——oo m -—-—oo 


Problems 


Find the complex Fourier series for the following functions. Then use MATLAB to plot the 
corresponding spectra. 


1.f(t) = ltl, —-"€tzm 2. FD) mus 0<t<2 

Sat 0<t<2 4.f(t) 20, -<tr 
|] 0, -mi2eq eo 

5. f= {> O<t<r/2 6. fü =t, —-1<t<1 

7.f(t) 21—-t, 0<t<6 8. f(t) =cos(t), 0«t«1 
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5.6 THE USE OF FOURIER SERIES IN THE SOLUTION OF ORDINARY 
DIFFERENTIAL EQUATIONS 


An important application of Fourier series is the solution of ordinary differential equa- 
tions. Structural engineers especially use this technique because the occupants of buildings 


and bridges often subject these structures to forces that are periodic in nature.!" 
e Example 5.6.1 
Let us find the general solution to the ordinary differential equation 
y" +9y = f(t), (5.6.1) 
where the forcing is 
f(t) = ltl, —mxtxm, f(t + 2x) = f(t). (5.6.2) 


This equation represents an oscillator forced by a driver whose displacement is the saw-tooth 
function. 

We begin by replacing the function f(t) by its Fourier series representation because 
the forcing function is periodic. The advantage of expressing f(t) as a Fourier series is its 
validity for any time t. The alternative would be to construct a solution over each interval 
nm « t « (n+1)z and then piece together the final solution assuming that the solution and 
its first derivative are continuous at each junction t = nz. Because the function is an even 
function, all of the sine terms vanish and the Fourier series is 


it = 7 4 5 cos|(2n — 1)t] 


(n I) (5.6.3) 


n= 


Next, we note that the general solution consists of the complementary solution, which 
equals 
y(t) = Acos(3t) + B sin(3t), (5.6.4) 


and the particular solution y,(t), which satisfies the differential equation 
oo 


—— ean sa» 


n=1 


To determine this particular solution, we write Equation 5.6.5 as 


m 4 4 4 
Yp yp = E cos(t) o7 cos(3t) — SER cos(5t) — ---. (5.6.6) 


By the method of undetermined coefficients, we guess the particular solution: 


Yp(t) = > + a4 cos(t) + bı sin(t) + a2 cos(3t) + b» sin(3t) + - -- (5.6.7) 


17 Timoshenko, S. P., 1943: Theory of suspension bridges. Part II. J. Franklin Inst., 235, 327-349; Inglis, 
C. E., 1934: A Mathematical Treatise on Vibrations in Railway Bridges. Cambridge University Press, 203 


Pp. 


226 Advanced Engineering Mathematics with MATLAB 


Yp(t) = ao + a cos[(2n — 1)t] + bn sin[(2n — 1)t]. (5.6.8) 
Because B | 
= M - (2n — 1) (a, cos((2n — 1)t] + b, sin[(2n — 1)t]}, (5.6.9) 
3 (2n — 1)? {an cos[(2n — 1)t] + bn sin[(2n — 1)t]) (5.6.10) 
2 
+ 2a9 + 92 n cos[(2n — 1)t] + bp sin[(2n — 1)t] = ; ‘ » en ue 
Or 
E a ; DP {9 (2n — 1Y?]a, 4 A i \ cos[(2n — 1)t] 


n=1 


+ $p- (2n — 1)?]b, sin[(2n — 1)t] = 0. (5.6.11) 


Because Equation 5.6.11 must hold true for any time, each harmonic must vanish separately 


and 
T 4 


9 — "^7 x0n-1y[ - (2n - 1?) 


and b, = 0. All of the coefficients ap are finite except for n = 2, where az becomes undefined. 
This coefficient is undefined because the harmonic cos(3t) in the forcing function resonates 
with the natural mode of the system. 

Let us review our analysis to date. We found that each harmonic in the forcing func- 
tion yields a corresponding harmonic in the particular solution, Equation 5.6.8. The only 
difficulty arises with the harmonic n — 2. Although our particular solution is not correct 
because it contains cos(3t), we suspect that if we remove that term, then the remaining 
harmonic solutions are correct. The problem is linear, and difficulties with one harmonic 
term should not affect other harmonics. But how shall we deal with the cos(3t) term in the 
forcing function? Let us denote that particular solution by Y(t) and modify our particular 
solution as follows: 


ao = (5.6.12) 


yp(t) = $ao + a1 cos(t) + Y (t) + as cos(5t) +--+. (5.6.13) 


Substituting this solution into the differential equation and simplifying, everything cancels 
except 


4 
Y" +9Y = — — cos(3t). (5.6.14) 
On 
The solution of this equation by the method of undetermined coefficients is 
d uc 
Y (t) = — —-—tsin(3t). (5.6.15) 
27m 


'This term, called a secular term, is the most important one in the solution. While the other 
terms merely represent simple oscillatory motion, the term t sin(3t) grows linearly with time 
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and eventually becomes the dominant term in the series. Consequently, the general solution 
equals the complementary plus the particular solution, or 


y(t) = Acos(3t) + B sin(3t) + is z = sin(3t) : y n mm pa 5616) 


nz2 


e Example 5.6.2 


Let us redo the previous problem only using complex Fourier series. That is, let us find 
the general solution to the ordinary differential equation 


oo i(2n— 
ei Qn 1)t 


7 " 2 
+ 9y = 5.6.17 
ae ie 27 (2n — 1)? EO 


From the method of undetermined coefficients we guess the particular solution for 
Equation 5.6.17 to be 


yp(f) =cot XO né, (5.6.18) 
'Then " 
yit) 2 M -(Qn- 1! e0n-Dt, (5.6.19) 


Substituting Equation 5.6.18 and Equation 5.6.19 into Equation 5.6.17, 


oo oo i(2n—1)t 


2 € 
- (2n = 1y!]e, e?n-0t = 7 6.20 
9co+ M. [9- (2n—1)"Jene mcn n — Ty (5.6.20) 


n=—Co n=—Co 


Because Equation 5.6.20 must be true for any t, 


7 and : (5.6.21) 
= 18) n = «(n - 1 [Qn — 1)? — 9] 
Therefore, 
T 2 Q ei(2n—1)t f 
=> +Í ane 5.6.22 
wl) = 1g * , P» (2n - en- 132 - 9]* ( ) 
However, there is a problem when n = —1 and n = 2. Therefore, we modify Equation 5.6.22 
to read 
T : ] 2 m gi Qn-1)t ] 
B lc t 3it E —3it < i(2n-1)t. 5.6.23 
Uplt) = ig rete" t eate Tuo (2n — 1 [On — 1? — 9]° ( ) 
nz-—1,2 


Introducing Equation 5.6.23 into Equation 5.6.17 and simplifying, 


1 1 


Tni and C—1 = ni (5.6.24) 


C2 = 
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'The general solution is then 


test — qe Bit oo ei(2n—1)t 


l 2 
= A 3it B —3it | T | . 
EA Be 18 27 ^ OU m 29. (2n — 13[2n — 19? — 9 


(5.6.25) 
nz-—1,2 


'The first two terms on the right side of Equation 5.6.25 represent the complementary solu- 
tion. Although this expansion is equivalent to Equation 5.6.16, we have all of the advantages 
of dealing with exponentials rather than sines and cosines. These advantages include ease 
of differentiation and integration, and writing the series in terms of amplitude and phase. 


e Example 5.6.3: Temperature within a spinning satellite 


In the design of artificial satellites, it is important to determine the temperature distri- 
bution on the spacecraft’s surface. An interesting special case is the temperature fluctuation 
in the skin due to the spinning of the vehicle. If the craft is thin-walled so that there is 
no radial dependence, Hrycak!? showed that he could approximate the nondimensional 
temperature field at the equator of the rotating satellite by 


2 
d T fT ad 3) L io PPE (5.6.26) 
dn? dn 4 4 1+78/4 
where 
1675 mB S\V/471478/4\'4 
b = 4 2,2 — 1 Pan d^ = 6.2 
MEd ax n eds ( E 4 ) i S (=) 1+, , (5 7) 
cos(277), O<n< $, 
F(n) = 0, issi, (5.6.28) 
cos(271), 3 xsi, 


a is the thermal diffusivity of the shell, f is the rate of spin, r is the radius of the spacecraft, 
S is the net direct solar heating, 8 is the ratio of the emissivity of the interior shell to the 
emissivity of the exterior surface, e is the overall emissivity of the exterior surface, y is 
the satellite's skin conductance, and c is the Stefan-Boltzmann constant. The independent 
variable 7 is the longitude along the equator with the effect of rotation subtracted out 
(211) = p—2r ft). The reference temperature To equals the temperature that the spacecraft 
would have if it spun with infinite angular speed so that the solar heating would be uniform 
around the craft. We nondimensionalized the temperature with respect to Tx. 
We begin by introducing the new variables 
3 n 2r?r? f To? 


ip e Cn = rie 5.6.29 
7 4 164478’ "apo ^ 79 4478 ( ) 


and p2 = c so that Equation 5.6.26 becomes 


d'y yov, D 
2 1! povo 


"NEN 
ds qj oY = Ao Fr). (5.6.30) 


18 From Hrycak, P., 1963: Temperature distribution in a spinning spherical space vehicle. AIAA J., 1, 
96-99. Reprinted with permission of the American Institute of Aeronautics and Astronautics. 
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Next, we expand F'(7) as a Fourier series because it is a periodic function of period 1. Since 
it is an even function, 


f(n) = $ao + Xan cos(2nmi), (5.6.31) 
n=l 
where 
E que yog oh. du 
TUUS 2 ae (2 = 5.6.32 
ao vd cos(272) dx + dum mx) dx m ( ) 
1 1/4 1 5 1 
a, = —- cos? (27a) da + —— cos’ (27%) dx = = (5.6.33) 
' Tea D 3/4 2 
and 
1 1/4 1 1 
An = 5] cos(272) cos(2nmx) dx + i] cos(2-z)cos(2nmx)dx (5.6.34) 
1/2 0 1/2 3/4 
2(—1)” nT 
ani n(n? = 1) cos( 2 ) ’ (5.6.35) 


if n > 2. Therefore, 


yt 


1 1 2— 
fn) =- o Egros (27n) — — are | 995 (Anm). (5.6.36) 


T 


From the method of undetermined coefficients, the particular solution is 


Yp(n) = $ao + a1 cos(2rn) + bı sin(2z) + S aan cos(4nz) + ben sin(4n7n), (5.6.37) 


n=1 


which yields 


y, (1) = —2raı sin(2mn) + 26; cos(2m) + y [-Anmaan sin(4nan) + 4nTbən cos(4n1))], 


(5.6.38) 
and 


yp (n) = —4n? [a1 cos(271) + bı sin(21)] — ` 16n? n’ [azn cos(4nrn) + ben sin(4nrn)]. 


n=1 
(5.6.39) 
Substituting into Equation 5.6.30, 
1 A A 
pedo EI Ana, + Anpovobi — paar RE cos(277) 

2 T 2 

+ (—4n?b; — 4T povoa: — pob) sin(277) 

= 2Aq(—1)” 
+ 2 |-16n?razn + BNT povobo;, poden H ES n cos(4nz1]) 
+ »5 (—16n?n?ba,, — BNT PoVoa2n — Paban) sin(4nrn) = 0. (5.6.40) 
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——— SOLUTION OF LINEARIZED EQUATION 


--- EXACT SOLUTION CONDUCTION , 
DISREGARDED 
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Figure 5.6.1: Temperature distribution along the equator of a spinning spherical satellite. (From Hrycak, 
P., 1963: Temperature distribution in a spinning spherical space vehicle. AIAA J., 1, 97. ©1963 AIAA, 
reprinted with permission.) 


To satisfy Equation 5.6.40 for any 7, we set 


2A A 
ao = -— (4r? ! po)a H 4mpovobi = CR Ampovoar + (4r? + gd)bi — 0, (5.6.41) 
0 
2A9(—1)^* 
(16n?5? + pe)a2n E 8nmpovobon = I and 8nT povoaon 4: (16n?r? + p2)bon = 0, 
m(4n? — 


(5.6.42) 
or 
An? + p2)A 
eee [167^ pov + (41^ + po) lbi = 2T povo 4o; 
(5.6.43) 


(5.6.44) 


[1617 pave + (4n? + p3)"Ja1 = — 


2A9(—1)^ (16n?7? + p2) 
v (4n? — 1) í 


[64n? 5? pivi + (16n?z? + pf) laon = 
and 
16(—1)” povon Ao 
4n? — 1 i 
Substituting for ag, a1, b1, dan, and bən, the particular solution is 


[64n2 7? pivi + (16n?z? + pg)’ ]ban = 


(5.6.45) 


Ao (4r? + på) Ao cos(277) |, — 2mpovoAosin(27) 
"pà  2[(4r2 + p2)2 --l6m?pQvg] (472 + p2) + 162212 


" 249 Y (—1)^(16n?z? + p2) cos(2nz1) 
1 2 s = 1)[64n?n pid + (16nn? + pP) 


Yp(n) = 


< (—1)”nsin(2nrn) 
— 16 A 
x 2- (4n? — 1)[64n?? pv + (16n?7? + pg)?] 


(5.6.46) 
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Figure 5.6.1 is from Hrycak's paper and shows the variation of the nondimensional 
temperature as a function of 7 for the spinning rate vo. The other parameters are typical 
of a satellite with aluminum skin and fully covered with glass-protected solar cells. As 
a check on the solution, we show the temperature field (the dashed line) of a nonrotating 
satellite where we neglect the effects of conduction and only radiation occurs. The difference 
between the vg = 0 solid and dashed lines arises primarily due to the linearization of the 
nonlinear radiation boundary condition during the derivation of the governing equations. 


Problems 


Solve the following ordinary differential equations by Fourier series if the forcing is given 
by the periodic function 


; 0ct«m, 
sO) -T«t«2m, 


and f(t) = f(t 4- 27): 
1. y” —y — f(t), 2. y" +y = f(t), 3. y" — 3y' + 2y = f(t). 
4. Solve the boundary-value problem: 

y" + 2y = 3z, 0czc«l, 


subject to the boundary conditions y(0) = y(1) = 0. Solve it two ways: (1) using techniques 
from Chapter 2 and (2) using Fourier sine series. 


5. Given 
oo 
y +ky= Y Cne”, -T <E<T, 


n=— oo 


find its solution in terms of a complex Fourier series. 


Solve the following ordinary differential equations by complex Fourier series if the forcing is 
given by the periodic function 


and f(t) = f(t + 27): 
6. y” —y = f(t), T. y" +4y = f(t). 


8. An object radiating into its nocturnal surrounding has a temperature y(t) governed by 
the equation!? 

dy ~~ ; 

d +ay = Ao + 5 An cos(nwt) + Bn sin(nwt), 


n=1 


where the constant a is the heat loss coefficient and the Fourier series describes the temporal 
variation of the atmospheric air temperature and the effective sky temperature. If y(0) = To, 
find y(t). 


19 See Sodha, M. S., 1982: Transient radiative cooling. Solar Energy, 28, 541. 
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9. The equation that governs the charge q on the capacitor of an LRC electrical circuit is 
q! + 2aq' +wq = o? E, 


where a = R/(2L), w? = 1/(LC), R denotes resistance, C denotes capacitance, L denotes 
the inductance, and E is the electromotive force driving the circuit. If E is given by 


oo 
- inwot 
B= X Pne€ , 


n-—-—oo 
find q(t). 
10. Use Fourier series to find the particular solution?? of the ordinary differential equation 


7 2 — _ 4.2 1, 0 « x « A/A, 
y" (x) + k'y(z) = —k ated M4 < x < Af2, 


where k, Vr, and A are constants. Extend the forcing function as an even function into the 
interval (—A/2, 0). 


5.7 FINITE FOURIER SERIES 


In many applications we must construct a Fourier series from values given by data or 
a graph. Unlike the situation with analytic formulas where we have an infinite number of 
data points and, consequently, an infinite number of terms in the Fourier series, the Fourier 
series contains a finite number of sines and cosines where the number of coefficients equals 
the number of data points. 

Assuming that these series are useful, the next question is how do we find the Fourier 
coefficients? We could compute them by numerically integrating Equation 5.1.6. However, 
the results would suffer from the truncation errors that afflict all numerical schemes. On 
the other hand, we can avoid this problem if we again employ the orthogonality properties 
of sines and cosines, now in their discrete form. Just as in the case of conventional Fourier 
series, we can use these properties to derive formulas for computing the Fourier coefficients. 
These results will be exact except for roundoff errors. 

We start by deriving some preliminary results. Let us define £m = mP/(2N). Then, 
if k is an integer, 


1—72N 


2N-1 À 2N—1 ; 2N—1 =0. r z 1 
3 Qrikxm 5 kmri 5 S I-r , , 


m=0 m=0 m=0 2N 


, 


because r?N = exp(2rki) = 1 if r Z 1. If r = 1, then the sum consists of 2N terms, each 
of which equals one. The condition r = 1 corresponds to k = 0,42N,+4N,.... Taking the 
real and imaginary part of Equation 5.7.1, 


2N—1 
Ikan 0, k £0, +2N,+4N,..., 
= zi P Jens k =0,+2N,+4N,..., (67:2) 


m=0 


20 See Chabert, P., J. L. Raimbault, J. M. Rax, and M. A. Lieberman, 2004: Self-consistent nonlinear 
transmission line model of standing wave effects in a capacitive discharge. Phys. Plasmas, 11, 1775-1785. 
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and 


for all k. 
Consider now the following sum: 


m=0 


0, 
N, 
2N, 


b» 2m kr, ad PETS E. 
P P 2 
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(5.7.3) 


(«s 


2n (k E | cos] 2 A ) 


|k — j| and |k 4 
|k — j| or |k + 
|k — j| and |k 4 


(5.7.4) 
-m| £0,2N,4N,..., 
m| 4 0,2N, AN, ..., (5.7.5) 
-m| =0,2N,4N,.... 


Let us simplify the right side of Equation 5.7.5 by restricting ourselves to k+ 7 lying between 
0 to 2N. This is permissible because of the periodic nature of this equation. If k + j = 0, 
k = j = 0; if k+j = 2N, k = j = N. In either case, k— j = 0 and the right side of Equation 
5.7.5 equals 2N. Consider now the case k Z j. Then k+ j Z 0 or 2N and k — j Z 0 or 2N. 
The right side of this equation must equal 0. Finally, if k = j Z 0 or N, then k + 740 or 
2N but k — j = 0 and the right side of this equation equals N. In summary, 


2N-1 ; 0 kzij 
Whom 270) : : 
»» cos( 2 ) cos( > ) -f N, k—jz0,N (5.7.6) 
MED 2N, k=j=0,N. 
In a similar manner, 
2N-1 : 
2mkzg 27 9Lm 
Y co ( m ) sin( ade ) =0 (5.7.7) 
m=0 E 
for all k and j and 
2N-1 ; 0 kzj 
Whom 27 7Lm, : : 
5 sin( 2 ) sin( M ) - [s k=740,N, (5.7.8) 
inc 0 k=j=0,N. 


Armed with these equations we are ready to find the coefficients A, and B, of the 
finite Fourier series, 


N-1 
Ap 2nkz . f 2rkx AN 2n Nx 
f(z) = F +> 41 cos ( 252.) + Bysin( P ) t cos( P | 
where we have 2N data points and now define P as the period of the function. 
To find Aj, we proceed as before and multiply Equation 5.7.9 by cos(2rjæ /P) (j may 


take on values from 0 to N) and sum from 0 to 2N — 1. At the point x = £m, 
2N-1 


N-1 . 
20j Ao s 27j 
2 f (zm) cos( P 2 = z cos P Lm 


2N-1 E 
2nk 2 
EN Ak 2. oos( Eam) cos( “Fem 


(5.7.9) 
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If 7 Z 0 or N, then the first summation on the right side vanishes by Equation 5.7.2, the 
third by Equation 5.7.8, and the fourth by Equation 5.7.6. The second summation does not 
vanish if k — j and equals N. Similar considerations lead to the formulas for the calculation 


of Ax and Br: 
2N-1 


1 Y mq km 
Ak = N m=0 fn cos( =") , k —0,1,2,..., N, (5.7.11) 
and 
TA m km 
D= x 2 fmsin( T), k=1,2,...,N—1, (5.7.12) 


where fm is the value of the function at the mth data point. 

It is important to note that 2N data points yield 2N Fourier coefficients Ay and Bx. 
As a consequence, our sampling frequency will always limit the amount of information, 
whether in the form of data points or Fourier coefficients. It might be argued that from the 
Fourier series representation of f(t) we could find the value of f(t) for any given t, which 
is more than we can do with the data alone. This is not true. Although we can calculate 
f(t) at any t using the finite Fourier series, the values may or may not be correct since the 
constraint on the finite Fourier series is that the series must fit the data in a least-squared 
sense. Despite the limitations imposed by only having a finite number of Fourier coefficients, 
the Fourier analysis of finite data sets yields valuable physical insights into the processes 
governing many physical systems. 

In the case when we have 2N + 1 (odd numbered) data points, a similar derivation 
gives 


Ao X Qrnj F 2mnj 

fm Y (aru) + Pes): (5.7.13) 

where j = 0,1,2,...,2N, A, and Bn are given by 

9 2N 

Aye T P» (5.7.14) 

2 e 2nmj 
An = gei f(s) m —1,2,...,N, (5.7.15) 

2 ai . army 
ZEE NACE m —1,2,...,N, (5.7.16) 


and f; is the value of the function at the jth data point. 
Finally, following Section 5.5, we can re-express the finite Fourier series in complex 
form. For N data points the complex Fourier series representation is 


N-1 
Y Ckexp (2rikn/N), n-20,1,2,..., N — 1, (5.7.17) 
k=0 


1 


f= 


where the complex Fourier coefficient C; is given by 


N-1 
Cy = 5 fn exp (—2rink/N), k—0,1,2,...,N — 1. (5.7.18) 


n=0 
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Table 5.7.1: The Depth of Water in the Harbor at Buffalo, NY (Minus the Low-Water 
Datum of 568.8 ft) on the 15t Day of Each Month during 1977 


mo n depth mo n depth mo n depth 
Jan 1 1.61 May 5 3.16 Sep 9 2.42 
Feb 2 1.57 Jun 6 2.95 Oct 10 2.95 
Mar 3 2.01 Jul 7 3.10 Nov 11 2.74 
Apr 4 2.68 Aug 8 2.90 Dec 12 2.63 


e Example 5.7.1 


Consider the simple case where we have 5 data points: fg = 1, fi = 1, fo = 1, f3 = 0, 
and f4 — 0. Using Equations 5.7.14 through 5.7.16 with N = 2, we find that 


Ao = (2/5) (£o + £1 + £2 + £3 + 24), (5.7.19) 
Ax = (2/5)[1 + cos(2rk/5) + cos(4rk/5], k — 1,2, (5.7.20) 

and 
By, = (2/5)|sin(21k/5) + sin(41k/5], k= 12: (5.7.21) 


These equations yield Ap = 1.2, Ay = Ap = 0.2, Bı = 0.61584, and By = —0.14531. When 
these Fourier coefficients were substituted into Equation 5.7.13, they gave back the original 
UE 

On the other hand, Equation 5.7.18 yields the complex Fourier coefficients 


Cy = exp(-2mik/5) [1 --2cos(21k/5)), ^— k —0,1,2,3,4, (5.7.22) 


or Co = 3, Cy = 0.5 — 1.538844, Cp = 0.5 + 0.363277, C3 = 0.5 — 0.363274, and C4 = 
0.5 + 1.538844. Upon substituting these complex Fourier coefficients into Equation 5.7.17 
we obtain the original data. 

We could have also used MATLAB to compute the complex Fourier coefficients Co 
through C4. By typing fft([1 1 1 0 0],5) we would have obtained the desired quantities. 


e Example 5.7.2: Water depth at Buffalo, NY 


Each entry?! in Table 5.7.1 gives the observed depth of water at Buffalo, NY (minus the 
low-water datum of 568.6 ft) on the 15*^ of the corresponding month during 1977. Assuming 
that the water level is a periodic function of 1 year, and that we took the observations at 
equal intervals, let us construct a finite Fourier series from these data. This corresponds to 
computing the Fourier coefficients Ao, A1,..., A6, B1,..., Bs, which give the mean level and 
harmonic fluctuations of the depth of water, the harmonics having the periods 12 months, 
6 months, 4 months, and so forth. 


21 National Ocean Survey, 1977: Great Lakes Water Level, 1977, Daily and Monthly Average Water 
Surface Elevations. National Oceanic and Atmospheric Administration. 
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In this problem, N — 6. Each data point gives the water depth for each month. From 
Equation 5.7.11 and Equation 5.7.12, 


11 
1 mkr 
A; = 6 2 Fem) cos( ZET) ; k = 0, 1, 2,3, 4, 5,6, (5.7.23) 
and 
B Ly du enh Oy eos (5.7.24) 
aoe Tm) SM| — |; = 1, 4,9,4,9. HER 
^ 6 6 


Ap — twice the mean level = +5.120 ft 
EU — harmonic component with a period of 12 mo = —0.566 ft 
Bı = harmonic component with a period of 12 mo = —0.128 ft 
A» — harmonic component with a period of 6 mo = —0.177 ft 
B» — harmonic component with a period of 6 mo — —0.372 ft 
As — harmonic component with a period of 4 mo — —0.110 ft 
B3 = harmonic component with a period of 4 mo = —0.123 ft 
A4 — harmonic component with a period of 3 mo = +0.025 ft 
B4 — harmonic component with a period of 3 mo = +0.052 ft 
As = harmonic component with a period of 2.4 mo = —0.079 ft 
Bs = harmonic component with a period of 2.4 mo = —0.131 ft 
Ag — harmonic component with a period of 2 mo — —0.107 ft 


Figure 5.7.1 is a plot of our results using Equation 5.7.9. Note that when we include 
all of the harmonic terms, the finite Fourier series fits the data points exactly. The values 
given by the series at points between the data points may be right or they may not. To 
illustrate this, we also plotted the values for the first of each month. Sometimes the values 
given by the Fourier series and these intermediate data points are quite different. 

Let us now examine our results in terms of various physical processes. In the long 
run the depth of water in the harbor at Buffalo, NY depends upon the three-way balance 
between precipitation, evaporation, and inflow-outflow of any rivers. Because the inflow and 
outflow of the rivers depends strongly upon precipitation, and evaporation is of secondary 
importance, the water level should correlate with the precipitation rate. It is well known 
that more precipitation falls during the warmer months rather than the colder months. 
The large amplitude of the Fourier coefficient A; and B1, corresponding to the annual cycle 
(k = 1), reflects this. 

Another important term in the harmonic analysis corresponds to the semiannual cycle 
(k — 2). During the winter months around Lake Ontario, precipitation falls as snow. 
Therefore, the inflow from rivers is greatly reduced. When spring comes, the snow and ice 
melt and a jump in the water level occurs. Because the second harmonic gives periodic 
variations associated with seasonal variations, this harmonic is absolutely necessary if we 
want to get the correct answer while the higher harmonics do not represent any specific 
physical process. 


e Example 5.7.3: Numerical computation of Fourier coefficients 


At the beginning of this chapter, we showed how you could compute the Fourier coeffi- 
cients ao, an, and bn from Equation 5.1.6 given a function f(t). All of this assumed that you 
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water level 


mean plus first harmonic 


water level 


mean plus first two harmonics 


water level 


mean plus first three harmonics 


water level 


mean plus all of the harmonics 
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Figure 5.7.1: Partial sums of the finite Fourier series for the depth of water in the harbor of Buffalo, NY 
during 1977. Circles indicate observations on the 15*^ of the month; crosses are observations on the first. 


could carry out the integrations. What do you do if you cannot perform the integrations? 
The obvious solution is perform it numerically. In this section we showed that the best 
approximation to Equation 5.1.6 is given by Equation 5.7.11 and Equation 5.7.12. In the 
case when we have f(t) this is still true but we may choose N as large as necessary to obtain 
the desired number of Fourier coefficients. 

To illustrate this we have redone Example 5.1.1 and plotted the exact (analytic) and 
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Figure 5.7.2: The computation of Fourier coefficients using a finite Fourier series when f(t) is given by 
Equation 5.1.8. The circles give an and bn as computed from Equation 5.1.9, Equation 5.1.10, and Equation 
5.1.11. The crosses give the corresponding Fourier coefficients given by the finite Fourier series with N — 15. 


numerically computed Fourier coefficients in Figure 5.7.2. T'his figure was created using the 
MATLAB script: 


clear; 

N = 15, M = 2*N; dt = 2*pi/M; ^ number of points in interval 
^4 create time points assuming x(t) = x(t+period) 
[-pi:dt:pi-dt] ; 


ct 
[l] 


f = zeros(size(t)); % initialize function f(t) 
for k = 1:length(t) % construct function f(t) 
if t(k) < 0; f(k) = 0; else f(k) = t(k); end; end; 
^ 
^4 compute Fourier coefficients using fast Fourier transform 
% 
fourier = fft(f) / N; 
a-0_comp = real(fourier(1)); sign = 1; 


for n = 2:N; 
a-n-comp(n-1) = - sign * real(fourier(n)); 
b.n.comp(n-1) = sign * imag(fourier(n)); 
sign - - sign; 

end 


% 

^4 plot comparisons 

% 

NN = linspace(0,N-1,N); 
exact_coeff (1) = pi/2; 
numer coeff(1) = a 0.comp; 
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for n = 1:N-1; 
exact coeff(n*1) 
numer coeff(n-*1) 

end; 

subplot (2,1,1),plot(NN,exact_coeff,’o’ ,NN,numer_coeff,’kx’) 

ylabel(’a_n’,’Fontsize’ ,20) 

clear exact_coeff numer.coeff 

NN = linspace(1,N-1,N-1); 

for n = 1:N-1; 
exact coeff(n) = -(-1)^n/n; numer .coeff(n) = bn comp(n); 

end; 

subplot(2,1,2), plot(NN,exact coeff,?o^,NN,numer coeff,"kx?) 

xlabel(?n?,?Fontsize?,20); ylabel(?b.n!,"Fontsize?,20); 


((-1)^n-1) / (pi*(2*n-1)^2); 
a n comp(n); 


It shows that relatively few data points can yield quite reasonable answers. 

Let us examine this script a little closer. One of the first things that you will note is 
that there is no explicit reference to Equation 5.7.11 and Equation 5.7.12. How did we get 
the correct answer? 

Although we could have coded Equation 5.7.11 and Equation 5.7.12, no one does that 
anymore. In the 1960s, J. W. Cooley and J. W. Tukey?? devised an incredibly clever method 
of performing these calculations. This method, commonly called a fast Fourier transform 
or FFT, is so popular that all computational packages contain it as an intrinsic function 
and MATLAB is no exception, calling it £ft. This is what has been used here. 

Although we now have an fft to compute the coefficients, this routine does not directly 
give the coefficients an and bn but rather some mysterious (complex) number that is related 
to an + ibn. This is a common problem in using a package’s FFT rather than your own 
and why the script divides by N and we keep changing the sign. The best method for 
discovering how to extract the coefficients an and bpn is to test it with a dataset created by 
a simple, finite series such as 


f(x) = 20 + cos(t) + 3sin(t) + 6 cos(2t) — 20 sin(2t) — 10 cos(3t) — 30sin(3t). (5.7.25) 


If the code is correct, it must give back the coefficient in Equation 5.7.25 to within round-off. 
Otherwise, something is wrong. 

Finally, most FFTs assume that the dataset will start repeating after the final data 
point. Therefore, when reading in the dataset, the point corresponding to x = L must be 
excluded. 


e Example 5.7.4: Aliasing 


In the previous example, we could only resolve phenomena with a period of 2 months 
or greater although we had data for each of the 12 months. This is an example of Nyquist’s 
sampling criteria:2° At least two samples are required to resolve the highest frequency in a 
periodically sampled record. 

Figure 5.7.3 will help explain this phenomenon. In case (a) we have quite a few data 
points over one cycle. Thus, our picture, constructed from data, is fairly good. In case (b), 


22 Cooley, J. W., and J. W. Tukey, 1965: An algorithm for machine calculation of complex Fourier series. 
Math. Comput., 19, 297—301. 


23 Nyquist, H., 1928: Certain topics in telegraph transmission theory. AIEE Trans., 47, 617-644. 
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Figure 5.7.3: The effect of sampling in the representation of periodic functions. 
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Figure 5.7.4: The sea elevation at the mouth of the Chesapeake Bay from its average depth as a function 
of time after 1 July 1985. 


we took only samples at the ridges and troughs of the wave. Although our picture of the 
real phenomenon is poor, at least we know that there is a wave. From this picture we see 
that even if we are lucky enough to take our observations at the ridges and troughs of a 
wave, we need at least two data points per cycle (one for the ridge, the other for the trough) 
to resolve the highest-frequency wave. 

In case (c) we have made a big mistake. We have taken a wave of frequency N Hz and 
misrepresented it as a wave of frequency N/2 Hz. This misrepresentation of a high-frequency 
wave by a lower-frequency wave is called aliasing. It arises because we are sampling a 
continuous signal at equal intervals. By comparing cases (b) and (c), we see that there is 
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Figure 5.7.5: The amplitude of the Fourier coefficients for the sea elevation at the Chesapeake Bay bridge 
and tunnel (top) and Baltimore harbor (bottom) as a function of period. 


a cutoff between aliased and nonaliased frequencies. This frequency is called the Nyquist 
or folding frequency. It corresponds to the highest frequency resolved by our finite Fourier 
analysis. 


Because most periodic functions require an infinite number of harmonics for their rep- 
resentation, aliasing of signals is a common problem. Thus the question is not “can I avoid 
aliasing?” but “can I live with it?" Quite often, we can construct our experiments to say 
yes. An example where aliasing is unavoidable occurs in a Western at the movies when 
we see the rapidly rotating spokes of the stagecoach's wheel. A movie is a sampling of 
continuous motion where we present the data as a succession of pictures. As such, a film 
aliases the high rate of revolution of the stagecoach's wheel in such a manner so that it 
appears to be stationary or rotating very slowly. 
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Figure 5.7.6: Same as Figure 5.7.4 but with the tides removed. 
e Example 5.7.5: Spectrum of the Chesapeake Bay 


For our final example, we perform a Fourier analysis of hourly sea-level measurements 
taken at the mouth of the Chesapeake Bay during the 2000 days from 9 April 1985 to 29 
June 1990. Figure 5.7.4 shows 200 days of this record, starting from 1 July 1985. As this 
figure shows, the measurements contain a wide range of oscillations. In particular, note the 
large peak near day 90 that corresponds to the passage of Hurricane Gloria during the early 
hours of 27 September 1985. 

Utilizing the entire 2000 days, we plotted the amplitude of the Fourier coefficients as 
a function of period in Figure 5.7.5. We see a general rise of the amplitude as the period 
increases. Especially noteworthy are the sharp peaks near periods of 12 and 24 hours. The 
largest peak is at 12.417 hours and corresponds to the semidiurnal tide. Thus, our Fourier 
analysis shows that the dominant oscillations at the mouth of the Chesapeake Bay are the 
tides. A similar situation occurs in Baltimore harbor. Furthermore, with this spectral 
information we could predict high and low tides very accurately. 

Although the tides are of great interest to some, they are a nuisance to others because 
they mask other physical processes that might be occurring. For that reason we would like 
to remove them from the tidal gauge history and see what is left. One way would be to 
zero out the Fourier coefficients corresponding to the tidal components and then plot the 
resulting Fourier series. Another method is to replace each hourly report with an average 
of hourly reports that occurred 24 hours ahead of and behind a particular report. We 
construct this average in such a manner that waves with periods of the tides sum to zero.*4 
Such a filter is a popular method for eliminating unwanted waves from a record. Filters 
play an important role in the analysis of data. We plotted the filtered sea level data in 
Figure 5.7.6. Note that summertime (0—50 days) produces little variation in the sea level 
compared to wintertime (100-150 days) when intense coastal storms occur. 


24 See Godin, G., 1972: The Analysis of Tides. University of Toronto Press, Section 2.1. 
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Problems 
By hand, find the finite Fourier series for the following pieces of data: 
1. f(0) 20, f(1) = 1, f(2) = 2, f(3) = 3, and N = 2. 
2. f(0) 2 1, f(1) 2 1, f(2) = —1, f(3) = -1, and N = 2. 


Project: Construction of a Finite Fourier Series 
Using Linear Algebra 


In Example 5.1.1 we show that the function f(t) given by Equation 5.1.8 can be re- 
expressed 


f= Ay X an cos(nt) + b, sin(nt), —n«t«m, 
2 n=1 
if 4 
—1)"-1 -—L)* 
fig E ae and bn = cp 
2 nm n 


There we stated the Fourier series fits f(t) in a “least squares sense.” In Section 5.7 we 
showed that we could also approximate f(t) with the finite Fourier series 


M-1 
f(t) = $40 + M Ax cos(kt) + By sin(kt) + $Ay cos(Mt), 
k=1 


if we sample f(t) at tm = (2m--1— M)v/M, where m = 0,1,2,..., M—1 and M is an even 

integer. Then we would use Equation 5.7.11 and Equation 5.7.12 to compute Aj, and By. 

Because MATLAB solves linear equations in a least-squares sense, this suggests that we could 

use MATLAB as an alternative method for finding a finite Fourier series approximation. 
Let us assume that 


A N 
f(t) = v + Y An cos(nt) + B, sin(nt). 


n=1 


Then sampling f(t) at the temporal points tm = —7+(2m—1)7/M, we obtain the following 
system of linear equations: 


N 

A : 
I EM An cos(ntm) + Bn sin(ntm) = f (tm), 
2 

n=1 
where m = 1,2,..., M. Write a MATLAB program using linsolve that solves this system 
for given N and M and compare your results with the exact answers ag, an and b, for 
various N and M. Consider the case when M > 2N 4-1 (overspecified system), M < 2N +1 
(underspecified system), and M — 2N 4-1 (equal number of unknowns and equations). Does 
this method yield any good results? If so, under which conditions? 


Project: Using MATLAB’s Fast Fourier Transform 


For each function defined in Problems 1 to 16 at the end of Section 5.1, use MATLAB’s 
function fft to compute the Fourier coefficients. Depending upon the number of data 
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Figure 5.7.7: Given the time function Equation 5.1.8 from Example 5.1.1, this figure gives the difference 
between the Fourier coefficients given by MATLAB’s function fft and the exact Fourier coefficients given 
by Equation 5.1.10 and Equation 5.1.11 as a function of harmonic. 


points that define the function, how do the Fourier coefficients that you compute from the 
fft compare with the ones that you found exactly? 


Project: Design Your Own Snow Tire, Part II 


In Part I of this project you examined the spectrum of a simple model for a snow tire and 
you found the effect of tread thickness and spacing on the spectrum of the noise produced 
as the treads struck the pavement. Clearly, if you were to introduce a more complex and 
perhaps more realistic model, the calculations would become very cumbersome. But now, 
capitalizing on the work of the previous project, you can use the fast Fourier transform 
to compute the spectrum once you decide on a tread pattern. That is the object of this 
project. 


Step 1: For —7 < t < Tt and assuming that this pattern repeats with a period of 27, devise 
a function f(t), where it equals 1 when the tread is striking the roadway and 0 when it is 
not. 


Step 2: Use the code that you developed in the previous project to find the amplitude of 
the Fourier coefficients as a function of the harmonic. Test out your code by recovering the 
results from Example 5.1.3. 
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Figure 5.7.8: Comparison of the spectrum between two types of tires. On the left the gap between the 
treads is uniform. On the right the gaps have been randomly placed. 


Step 3: Our tire pattern of two thin treads is not very realistic. Modify your code so that 
it now has 4 thick treads separated by thin gaps. Compare the spectrum when the gaps are 
uniformly spaced and one where they are randomly spaced. 


Project: Spectrum of the Earth's Orography 


Table 5.7.2 gives the orographic height of the earth’s surface used in an atmospheric 
general circulation model (GCM) at a resolution of 2.5? longitude along the latitude belts 
of 28°S, 36°N, and 66°N. In this project you will find the spectrum of this orographic field 
along the various latitude belts. 


Step 1: Write a MATLAB script that reads in the data and find A, and B, and then 
construct the amplitude spectra for this data. 


Step 2: Construct several spectra by using every data point, every other data point, etc. 
How do the magnitudes of the Fourier coefficient change? You might like to read about 
leakage from a book on harmonic analysis.?° 


Step 8: Compare and contrast the spectra from the various latitude belts. How do the 
magnitudes of the Fourier coefficients decrease with n? Why are there these differences? 


25 For example, Bloomfield, P., 1976: Fourier Analysis of Time Series: An Introduction. John Wiley & 
Sons, 258 pp. 
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Figure 5.7.9: The orography of the earth and its spectrum in meters along three latitude belts using a 
topography dataset with a resolution of 2.5? longitude. 


Step 4: You may have noted that some of the heights are negative, even in the middle of 
the ocean! Take the original data (for any latitude belt) and zero out all of the negative 
heights. Find the spectra for this new data set. How have the spectra changed? Is there a 
reason why the negative heights were introduced? 


Further Readings 


Carslaw, H. S., 1950: An Introduction to the Theory of Fourier’s Series and Integrals. 
Dover, 368 pp. A classic treatment of the Fourier technique. 


Tolstov, Georgi P., 1976: Fourier Series. Dover, 336 pp. This book covers the basic theory 
of Fourier series and its use in mathematical physics. 
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Table 5.7.2: Orographic Heights (in m) Times the Gravitational Acceleration Constant 
(g = 9.81 m/s?) along Three Latitude Belts. The data is also given in the file oro- 
graphic.txt on the CRC website. 


Longitude 28°S 36°N 66°N Longitude 28°S 36°N 66°N 


—180.0 4. 3. 2532. —70.0 19317. —8. 1830. 
—177.5 al —2. 1665. —67.5 21681. 0. 3000. 
—175.0 1. 2; 1432. —65.0 9222. —2. 3668. 
—172.5 1. —3. 1213. —62.5 1949. —2. 2147. 
—170.0 1. f 501. —60.0 TTA. 0. 391. 
—167.5 T. —3. 367. —57.5 955. 5. —T7. 
—165.0 L; il 963. —55.0 2268. 6. 601. 
—162.5 0. 0. 1814. —52.5 4636. ex. 3266. 
—160.0 —1. 6. 2562. —50.0 4621. 2i 9128. 
—157.5 0. 1. 3150. —47.5 1300. —4. 17808. 
—155.0 0. 3. 4008. —45.0 —91. 1. 22960. 
—152.5 1. =). 4980. —42.5 5T. —1. 20559. 
—150.0 =); 4. 6011. —40.0 —25. 4. 14296. 
—14T.5 6. ex 6273. —37.5 13. —1. 9783. 
—145.0 14. 3. 5928. —35.0 —10. 6. 5969. 
—142.5 6. —1. 6509. —32.5 8. 2. 1972. 
—140.0 —2. 6. 7865. —30.0 —4. 22. 640. 
—137.5 0. 3. 7752. —27.5 6. 33. 379. 
—135.0 —2. 5. 6817. —25.0 —2. 39. 286. 
—132.5 1. = 2) 6272. —22.5 3. 2: 981. 
—130.0 —2. 0. 5582. —20.0 —3. 11. 1971. 
—12T.5 0. 5. 4412. —17.5 1. —6. 2576. 
—125.0 m 423. 3206. —15.0 —1. 19. 1692. 
—122.5 1. 3688. 2653. —12.5 0. —18. 357. 
—120.0 —3. 10919. 2702. —10.0 —1. 490. —21. 
—117.5 2. 106148. 3062. —7.5 0. 2164. —5. 
—115.0 —3. 17624. 3344. —5.0 1. 4728. —10. 
—112.5 T. | 18132. 3444. —2.5 0. 5347. 0. 
—110.0 12. 19511. 3262. 0.0 4. 2667. —6. 
—107.5 9. 22619. 3001. 2.5 —5. 1213. =I 
—105.0 —5. 20273. 2931. 5.0 i 1612. —31. 
—102.5 3. 12914. 2633. 7.5 —13. 1744. —58. 
—100.0 —5. 1434. 1933. 10.0 28. 1153. 381. 

—97.5 6. 4311. 1473. 12.5 107. 838. 2472. 

—95.0 —8. 2933. 1689. 15.0 2208. 1313. 5263. 

—92.5 8. 2404. 2318. 17.5 6566. 862. 5646. 

—90.0 —12. 1721 2285. 20.0 9091. 1509. 3672. 

—87.5 18. 1681. 1561. 22.5 10690. 2483. 1628. 

—85.0 —23. 2666. 1199. 25.0 12715. 1697. 889. 

—82.5 36. 4047. 737. 27.5 14583. 3377. 1366. 

—80.0 —64. 3938. 185. 30.0 11351. 7682. 1857. 

—77.5 138. 1669. 71. 32.5 3370. 9663. 1534. 

—75.0 —363. 236. 160. 35.0 15. 10197. 993. 


—72.5 4692. 31. 823. 37.5 49. | 10792. 863. 
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Table 5.7.2, contd.: Orographic Heights (in m) Times the Gravitational Acceleration 
Constant (g — 9.81 m/s?) along Three Latitude Belts 


Longitude 28°S 36°N 66°N Longitude 28°S 36°N 66°N 


40.0 —31. 11322. 756. 110.0 —17. 12639. 4674. 
42.5 20. 13321. 620. 112.5 302. 10543. 4435. 
45.0 —17. 15414. 626. 115.0 1874. 4967. 3646. 
47.5 —19. 12873. 8306. 117.5 4005. 1119. 2655. 
50.0 —18. 6114. 1029. 120.0 4989. 696. 2065. 
52.5 6. 2962. 946. 122.5 4887. 475. 1583. 
55.0 —2. 4913. 828. 125.0 4445. 1631. 3072. 
57.5 3. 6600. 1247. 127.5 4362. 2933. 7290. 
60.0 —3. 4885. 2091. 130.0 4368. 1329. 8541. 
62.5 2. 3380. 2276. 132.5 3485. 88. 7078. 
65.0 EE 5842. 1870. 135.0 1921. 598. 1322. 
67.5 2. 12106. 1215. 137.5 670. 1983. 9445. 
70.0 0. 23032. 680. 140.0 666. 2511. 10692. 
12.5 2. | 35376. 531. 142.5 1275. 866. 9280. 
75.0 —1. 36415. 539. 145.0 1865. 13. 8372. 
77.5 1. 26544. 579. 147.5 2452. 11. 6624. 
80.0 0. 19363. 554. 150.0 3160. —4. 3617. 
82.5 1. 17915. 632. 152.5 2676. -—]1. 2717. 
85.0 —2. 22260. 791. 155.0 697. 0. 3474. 
87.5 —1. 30442. 1455. 157.5 —67. —3. 4337. 
90.0 —3. 33601. 3194. 160.0 25. 3. 4824. 
92.5 —1. 30873. 4878. 162.5 —12. =i; 5525. 
95.0 0. | 31865. 5903. 165.0 10. 4. 6323. 
97.5 0. 35538. 6222. 167.5 —5. —2. 5899. 
100.0 —2. | 31985. 5523. 170.0 0. 1. 4330. 
102.5 0. 23246. 4823. 172.5 0. —4. 3338. 
105.0 —4. 17303. 4689. 175.0 4. 3. 3408. 
107.5 2. 14315. 4698. 177.5 3 —1. 3407. 


ckm = 0.01 


k IG(@)l 


cYkm = 0.1 


cYkm — 1 


0.0 0.5 To 15 2.0 
0/06 


Chapter 6 
The Fourier Transform 


In the previous chapter you learned how to expand a periodic function in terms of an 
infinite sum of sines and cosines. However, most functions encountered in engineering are 
aperiodic. As we shall see, the extension of Fourier series to these functions leads to the 
Fourier transform. 


6.1 FOURIER TRANSFORMS 


The Fourier transform is the natural extension of Fourier series to a function f(t) of 
infinite period. To show this, consider a periodic function f(t) of period 2T that satisfies 
the so-called Dirichlet's conditions.! If the integral T | f(t)| dt exists, this function has the 
complex Fourier series 


JOS So uam (6.1.1) 
where 
1 " —innt/T 
Cn = rl, f(t)e t. (6.1.2) 


Equation 6.1.1 applies only if f(t) is continuous at t; if f (t) suffers from a jump discontinuity 
at t, then the left side of Equation 6.1.1 equals [f (t+)+f(t7)], where f(t*) = lim, 4 f(x) 
and f(t^) = lim, ,,- f(x). Substituting Equation 6.1.2 into Equation 6.1.1, 


oo 


T 
JO = E OC us J i f(z)e T da. (6.1.3) 


n=—Co 


1 A function f(t) satisfies Dirichlet’s conditions in the interval (a,b) if (1) it is bounded in (a,b), and 


(2) it has at most a finite number of discontinuities and a finite number of maxima and minima in that 
interval. 
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Let us now introduce the notation wn = n-/T so that Awn = wn+1 — wn = T/T. Then, 


f(t)— > Y F (wn) Aus, (6.1.4) 
where 
T y 
F (wn) = = f(z)e "da. (6.1.5) 


As T — oo, wn approaches a continuous variable w, and Aw, may be interpreted as the 
infinitesimal dw. Therefore, ignoring any possible difficulties,” 


f()- xz]. F(w)e'*! dw, (6.1.6) 


and 


F(w) = J fedt. (6.1.7) 


Equation 6.1.7 is the Fourier transform of f(t) while Equation 6.1.6 is the inverse Fourier 
transform that converts a Fourier transform back to f(t). Alternatively, we may combine 
Equation 6.1.6 and Equation 6.1.7 to yield the equivalent real form 


f(t) = Ju T f (a) cos[w(t — x)] as] dw. (6.1.8) 


Hamming? suggested the following analog in understanding the Fourier transform. Let 
us imagine that f(t) is a light beam. Then the Fourier transform, like a glass prism, breaks 
up the function into its component frequencies w, each of intensity F(w). In optics, the 
various frequencies are called colors; by analogy the Fourier transform gives us the color 
spectrum of a function. On the other hand, the inverse Fourier transform blends a function’s 
spectrum to give back the original function. 

Most signals encountered in practice have Fourier transforms because they are abso- 
lutely integrable, since they are bounded and of finite duration. However, there are some 
notable exceptions. Examples include the trigonometric functions sine and cosine. 


2 For a rigorous derivation, see Titchmarsh, E. C., 1948: Introduction to the Theory of Fourier Integrals. 
Oxford University Press, Chapter 1. 


3 Hamming, R. W., 1977: Digital Filters. Prentice-Hall, p. 136. 
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e Example 6.1.1 


Let us find the Fourier transform for 


1, [t| <a, 
doe { 0, l>a. (6.1.9) 
From the definition of the Fourier transform, 
F(w) =| Oe dt «f le dt «f Oe" dt (6.1.10) 
wai ,—wat 9 si 
aes = sna) = 2asinc(wa), (6.1.11) 
wi w 


where sinc(x) = sin(x)/x is the sinc function. 
From the definition of the inverse Fourier transform, 


E Cus s op, [t| <a, 
f(t) = - | “ae ee ts ll > a. E 


— oo 
An important question is what value does f(t) converge to in the limit as t > a and 
t — —a? Because Fourier transforms are an extension of Fourier series, the behavior at a 


jump is the same as that for a Fourier series. For that reason, f(a) = [f (a*) Tf(a-)]- i 


and f(—a) = 4[f(-a*) + f(-a)] = 3. 


Although our previous example does not show it, the Fourier transform is, in general, 
a complex function. The most common method of displaying it is to plot its amplitude 
and phase on two separate graphs for all values of w. Another problem here is the ratio of 
0/0 when w = 0. Applying L'Hópital's rule, we find that F(0) = 2. Thus, we can plot the 
amplitude and phase of Fw) using the MATLAB script: 


clear; % clear all previous computations 

omegan = [-20:0.01:-0.01]; % set up negative frequencies 
omegap = [0.01:0.01:20]; % set up positive frequencies 

^4 compute Fourier transform for negative frequencies 

f omegan - 2.*sin(omegan)./omegan; 

^4 compute Fourier transform for positive frequencies 

f omegap - 2.*sin(omegap)./omegap; 

% concatenate all of the frequencies 

omega = [omegan,0,omegap] ; 

^ bring together the Fourier transforms found 

4 at positive and negative frequencies 

f omega = [f omegan,2,f omegapl; 

amplitude = abs(f omega); % compute the amplitude 

phase = atan2(0,f omega); % compute the phase 

clf; % clear all previous figures 

% plot frequency spectrum 

subplot (2,1,1), plot (omega, amplitude) 

^4 label amplitude plot 

ylabel(’ |F(\omega) | /a? ,?FontSize?,15) 

subplot(2,1,2), plot(omega,phase) ^ plot phase of transform 
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Sor 


Figure 6.1.1: Graph of the Fourier transform for Equation 6.1.9. 


ylabel(’phase’,’FontSize’,15) ^ label amplitude plot 
xlabel(’\omega’,’FontSize’,15) % label x-axis. 

Figure 6.1.1 shows the output from the MATLAB script. Of these two quantities, the am- 
plitude is by far the more popular one and is given the special name of frequency spectrum. 


e Example 6.1.2: Dirac delta function 


Of the many functions that have a Fourier transform, a particularly important one is 
the (Dirac) delta function.* For example, in Section 6.6 we will use it to solve differential 
equations. We define it as the inverse of the Fourier transform F(w) = 1. Therefore, 


ó(t) : J tdw. (6.1.13) 


= Se EA 


To give some insight into the nature of the delta function, consider another band-limited 
transform 


|. fi, lw] < Q, 
Fo(w) = D kabet (6.1.14) 
where Q is real and positive. Then, 
p $5. Q sin(Qt) 
t) = — tot dw = — : 6.1.15 
fo(t) 2T I. d am Ot ( ) 


Figure 6.1.2 illustrates fo(t) for a large value of Q. We observe that as Q — oo, folt) 
becomes very large near t = 0 as well as very narrow. On the other hand, fo(t) rapidly 
approaches zero as |t| increases. Therefore, the delta function is given by the limit 


ó(t) = lim 


Q— o0 mt 


sin(Qt) _ Ve t — 0, (6.1.16) 


0  tz0. 


^ Dirac, P. A. M., 1947: The Principles of Quantum Mechanics. Oxford University Press, Section 15. 
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fot) 


Figure 6.1.2: Graph of the function given in Equation 6.1.15 for Q = 300. 


Because the Fourier transform of the delta function equals one, 
J ó(t)e dt = 1. (6.1.17) 
Since Equation 6.1.17 must hold for any w, we take w = 0 and find that 
J ó(t) dt = 1. (6.1.18) 
'Thus, the area under the delta function equals unity. Taking Equation 6.1.16 into account, 
we can also write Equation 6.1.18 as 
b 
ó(t) dt = 1, a,b » 0. (6.1.19) 


Finally, from the law of the mean of integrals, we have the sifting property that 


b 
f f(t)d(t — to) dt = f (to), (6.1.20) 


if a < tg < b. This property is given its name because ó(t — to) acts as a sieve, selecting 
from all possible values of f(t) its value at t — to. 

We can also use several other functions with equal validity to represent the delta func- 
tion. These include the limiting case of the following rectangular or triangular distributions: 


ix 1 ( A t) 
in : or t-—lim4*M - e," ltl « e, (6.1.21) 
lt] > 5 e 0, |t| > €, 


and the Gaussian function: 
— rt? 
6(t) = lim exp(—nt /e) 


c€—0 ve 


Note that the delta function is an even function. 


(6.1.22) 
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The Fourier Transforms of Some Commonly Encountered Functions 


F(t), [t] < oc F(w) 
1 
1. e*H(t) a>0 - 
à -F et 
1 
2 e“H(-t), a»0 ; 
à — oi 
3 te *H(t), a»0 : 
f (a + wi)? 
—1 
4 te“ H(-t 0 
PUBCON UU (a — wi)? 
n! 
5 te “ H(t), R 0 152.4. ONERE EE 
É Sofa) dee a (a+ wi)” tt 
2a 
—al|t 
6 eal l, a0 deae 
7 teelt a>0 _— twi 
, (w? + a2)? 
1 T 
8. e leal 
14+? al^ 
cos(at) ee Pn ee ee 
9 ola z (e-le=al + g-letal) 
sin(at) T —|w—a —|wta 
10. a z (c-le-al — ¢-letal) 
Hu 1, t| «a 2sin(wa) 
` 0, [t| >a w 
sin(at) T/a, lw] <a 
12. 
at 0, lw| >a 


2 
13. et” a > 0 d - exp (5) 
a 4a 


Note: The Heaviside step function H(t) is defined by Equation 6.1.35. 
e Example 6.1.3: Fourier transform of Bessel functions 


In Section 12.2 we will introduce Bessel functions of the first kind of order n, Jn(t); 
they are useful in solving partial differential equations. For the present we can consider 
them tabulated functions, similar to sine and cosine, that are computed by power series. In 
the case of Jo(t) it could also be computed via the definite integral:? 


T 


Jo(t) = d A cos|[t sin(y)] dy. (6.1.23) 


5 Watson, G. N., 1966: A Treatise on the Theory of Bessel Functions. Cambridge University Press, p. 
176, Equation (4) with v = 0. 
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If we introduce 
_ arcsin(w), 0<y<7/2, 
aa n — arcsin(w), 7/2 « p «m, (6324) 


we can rewrite Equation 6.1.23 as 


Jo(t) = e" dw (6.1.25) 


2 [! cos(tw) d 1 [! cos(tw) d 1 [ 1 
W = UW) = 
T Jo v1 -— w? T Jı V1 -— w? T Jı Vl- w2 


1 em 2 i 
— H(1— —— e" dw. 6.1.26 
x | E0- Medo (6.1.26) 


From the form of Equation 6.1.26, we recognize that Jo(t) is the inverse Fourier transform 
of 2H (1 — |w|)/V1 — w?. Note that the Fourier transform is nonzero if |w| < 1. This is an 
example of a bandlimited Fourier transform. 

For the general case of J;,(t), H. O. Bèca? proved that 


F [Jam (w)] = = cos[2m arcsin(w)] H (1 — |w|), (6.1.27) 
and 9j 
F [Joi ()] = A sin[(2m + 1) arcsin(w)] H (1 — |wl), (6.1.28) 


where m = 0, £1, €£2,.... 


e Example 6.1.4: Multiple Fourier transforms 


The concept of Fourier transforms can be extended to multivariable functions. Consider 
a two-dimensional function f(x,y). Then, holding y constant, 


G(&. y) =| Tin y) e da. (6.1.29) 
Then, holding £ constant, 
F(E, n) =| G(&, y) e" dy. (6.1.30) 


Therefore, the double Fourier transform of f(x, y) is 


rén-f ris f(x,y) e E+) qs dy, (6.1.31) 


assuming that the integral exists. 
In a similar manner, we can compute f(x,y) given F(£,r) by reversing the process. 
Starting with 


Glu) =5- fF mean, (6.1.32) 


6 Béca, H. O., 1980: An orthogonal set based on Bessel functions of the first kind. Univ. Beograd. Publ. 
Elektrotehn. Fak., Ser. Mat. Fiz., No. 695, 85-90. 
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followed by T 
f(z,y)- x] G(E, y) e'** d£, (6.1.33) 


we find that 


ren = uif l F(E, n) e» dé dn. (6.1.34) 


e Example 6.1.5: Computation of Fourier transforms using MATLAB 
The Heaviside (unit) step function is a piecewise continuous function defined by 


1, ta, 
H(t—a)= ‘i in (6.1.35) 


where a > 0. We will have much to say about this very useful function in the chapter on 
Laplace transforms. Presently we will use it to express functions whose definition changes 
over different ranges of t. For example, the “top hat" function Equation 6.1.9 can be 
rewritten f(t) = H(t-- a) — H(t — a). We can see that this is correct by considering various 
ranges of t. For example, if t < —a, both step functions equal zero and f(t) = 0. On 
the other hand, if t > a, both step functions equal one and again f(t) = 0. Finally, for 
—a « t « a, the first step function equals one while the second one equals zero. In this 
case, f(t) = 1. Therefore, f(t) = H(t + a) — H(t — a) is equivalent to Equation 6.1.9. 
'This ability to rewrite functions in terms of the step function is crucial if you want to 
use MATLAB to compute the Fourier transform via the MATLAB routine fourier. For ex- 
ample, how would we compute the Fourier transform of the signum function? The MATLAB 
commands: 
>> syms omega t; syms a positive 
>> fourier (’Heaviside(t+a)-Heaviside(t-a)’,t,omega) 
>> simplify (ans) 


yields 
ans = 
2*sin(a*omega)/omega 


the correct answer. 


e Example 6.1.6: Numerical computation of Fourier transforms using MATLAB 


As our table on Fourier transform suggests, there are relatively few functions that 
possess a Fourier transform and even fewer for which we can write it down. For that 
reason we must numerically integrate Equation 6.1.7. The idea here is that we replace the 
integration from —oo to oo with one from —T to T and then use the trapezoid rule. We 
must choose T large enough so that it captures the behavior of f(t). 

To illustrate this technique using MATLAB, let us use the function f(t) = te * H(t) 
which has the transform F(w) = 1/(1 + wi)?. We begin by tabulating the function for 
times: 


N = 20; dt = 0.1; t = [-N/2:N/2]*dt; 
for n = 1:N+1 


The Fourier Transform 257 


RIF (w)] 


Figure 6.1.3: The real and imaginary part of the Fourier transform F(w) for f(t) = te-* H(t) computed 
by numerically integrating the definition for the Fourier transform, Equation 6.1.7. The upper and lower 
limits have been replaced by +T, respectively. The solid line gives the exact result, the dashed line T = 1, 
and the dotted line T = 2. The function f(t) was sampled at the interval At = 0.1. 


if t(n) < 0 

f(n) = 0; 

else 

f(n) = t(n) * exp(-t(n)); 
end 


end 


Having computed f(n), we do the numerical integral by the trapezoid rule using 
MATLAB’s procedure trapz: 


k = 0; 
for omega = -8:0.1:8 
k = kł+1; 


Omega (k) = omega; 
F(k) = trapz(t,f.*exp(-i*omega*t)); ^ the Fourier transform 
end 


FR 
FI 


real(F); % [F(w)] 
imag(F); 4 S[F(w)| 

Figure 5.1.3 compares results from the numerical integration when T' = 1 (dashed line) 
and T — 2 (dotted line) with the exact answer (solid line). Because the integrand rapidly 
approaches zero for increasing t the results are rather good for a relatively small T. The 
optimal choice for T' is dictated by the behavior of f(t) with t. 

An alternative method of computing the Fourier transform uses the fast Fourier trans- 
form. Recall that we derived the Fourier transform by considering a periodic function f(t) 
defined on the interval (—T, T). The Fourier transform equals the Fourier coefficients in the 
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Figure 6.1.4: The real and imaginary part of the Fourier transform F(w) for f(t) = te-* H(t) computed 
using the fast Fourier transform. The solid line gives the exact result, the dashed line T = 1, and the dotted 
line T = 2. The function f(t) was sampled at the interval At = 0.1. 


limit T' — oo. As we showed in Section 5.7 we can compute these Fourier coefficients very 
efficiently using the fast Fourier transform. 


To illustrate this technique, we again will compute the Fourier transform for f(t) — 
te * H(t). Our first step is to compute f(t) over the interval [0,27] using the periodicity 
condition that f(t + 2T) = f(t). The corresponding MATLAB code to create f(n) for 
T = 1.6 is: 

N = 32; dt = 0.1; t = [0:N-1]*dt; 
x = zeros(1,N); 

for n = 1:N/2 

x(n) = t(n) * exp(-t(n)); 

end 


Next, we use MATLAB’s intrinsic function fft to compute the Fourier coefficients over 
the interval [0,2Q), where Q = 1/(2At) and At equals the time interval that we have 
sampled f(t). The Fourier transform is simply X = fft(x) * dt. 


Because we generally prefer to have the Fourier transform over the interval [—Q, Q], we 
use MATLAB’s intrinsic function fftshift to shift X to that interval. The MATLAB code is: 


M = length(X) 

fshift = [-M/2:M/2-1] / (M*dt); % frequency of F(w) 
yshift = fftshift(xX); 4 F(w) 

Omegal = 2*pi*fshift; % w 


Figure 5.1.4 presents the results when T = 1.6 (dashed line) and T = 3.2 (dotted line) 
with the exact answer (solid line). 
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Problems 


1. (a) Show that the Fourier transform of 


2a 

t) = e all 2-0 i F(w) = ———. 
fie", a0 is Pw) = 
Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Use MATLAB’s fourier to find F(w). 


2. (a) Show that the Fourier transform of 


4awi 

t) = te "Itl >0 is Fw)=-——- 
Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Use MATLAB's fourier to find F(w). 


3. (a) Show that the Fourier transform of 


f(t) = en ot a> 0, is F(w) = "ES (-=) i 


Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Use MATLAB's fourier to find F(w). 


4. (a) Show that the Fourier transform of 


Lj ent t « 0, : u 3 
m-[T 12$ 0» F- 


Using MATLAB, plot the amplitude and phase spectra for this transform. 


(2—iw)(1 + iw) 
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(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F(w). 


5. (a) Show that the Fourier transform of 


fen Grae, t>0, , (2 —2i(w + 1) 
f(t) — { Le - 0t t< 0, 1S F( ) 


Using MATLAB, plot the amplitude and phase spectra for this transform. 


—(wT1?-1 


(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F(w). 


6. (a) Show that the Fourier transform of 


days DEM [t| « 1, is Pes sin(v — a) , sin(v + a) 


0, [t| > 1, w—a w+a 
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Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F(w). 


T. (a) Show that the Fourier transform of 


f(t) = w 0<t<1, 


0, otherwise, 


is 
F(w) = 


1[1-—cos(w —1) , cos(w +1) -— H i ES — 1)  sin(w- 1) 


2 w— 1 i w+1 2 w—1 w+1 


Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F (w). 


8. (a) Show that the Fourier transform of 


_ t/a, [t| « a, 2 . 2icos(wa)  2isin(wa) 
iom { 0, |t| > a, 7 di w wa ` 
Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F (w). 


9. (a) Show that the Fourier transform of 


(£/a) Nem 24 Acos(wa) 4sin(wa) | 2sin(wa) 
F(t) { 0, [t| >a, ur d) wa wa? " w 


Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F (w). 


10. (a) Show that the Fourier transform of 


- 2 —iwT - 
noes { 1-t/r, 0xt«2r, i e sin(wr) bets) 


0, otherwise, tw WT 
Using MATLAB, plot the amplitude and phase spectra for this transform. 
(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F(w). 


11. (a) Show that the Fourier transform of 


_ f[1- (t/a), [t| X a, . Asin(wa) — 4aw cos(wa) 
fi) = { 0. "EP and — F(w) = E 


Using MATLAB, plot the amplitude and phase spectra for this transform. 


(b) Rewrite f(t) in terms of step functions. Then use MATLAB’s fourier to find F(w). 
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R[F(w)] 


Figure 6.1.5: The real part of the Fourier transform F(w) for f(t) = 1/(t? + 1)3/? using the trapezoidal 
rule to numerically integrate the definition for the Fourier transform, Equation 6.1.7. The imaginary part 
equals zero. The solid line gives the exact result from Problem 12, the dashed line T' = 1, and the dotted 
line T = 2. The function f(t) was sampled at the interval At = 0.1. 


12. The integral representation’ of the modified Bessel function K,(-) is 


T (v +4) 2a)" F cos(wt) y 
"e 


eT) A Crayne 


K, (alw|) = 


where I'(-) is the gamma function, v > 0 and a > 0. Use this relationship to show that 


1 u 2\w|’T (3) Ky (alo) 
F evan = T(v+ 1) (2a)" 


Use MATLAB to verify your result by numerical integration. 


13. Show that d 
F[H(a — |t] = mn a » 0. 


14. Show that " 
" TÓ(t —r)dr —t|H(t — a) - H(t—V)]. 
Hint: Use integration by parts. 


15. For the real function f(t) with Fourier transform F(w), prove that |F(w)| = |F(—w)| 
and the phase of F(w) is an odd function of w. 


7 Watson, G. N., 1966: A Treatise on the Theory of Bessel Functions. Cambridge University Press, p. 
185. 
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6.2 FOURIER TRANSFORMS CONTAINING THE DELTA FUNCTION 


In the previous section we stressed the fact that such simple functions as cosine and 
sine are not absolutely integrable. Does this mean that these functions do not possess a 
Fourier transform? In this section we shall show that certain functions can still have a 
Fourier transform even though we cannot compute them directly. 

'The reason why we can find the Fourier transform of certain functions that are not 
absolutely integrable lies with the introduction of the delta function because 


J ó(w — woe” dw = et (6.2.1) 


for all t. Thus, the inverse of the Fourier transform ó(w — wo) is the complex exponential 
eto! [25 or l 
F (et) = 2rô(w — wo). (6.2.2) 


This immediately yields the result that 
F (1) = 2rå(w), (6.2.3) 


if we set wọ = 0. Thus, the Fourier transform of 1 is an impulse at w = 0 with weight 
2x. Because the Fourier transform equals zero for all w Æ 0, f(t) = 1 does not contain a 
nonzero frequency and is consequently a DC signal. 

Another set of transforms arises from Euler's formula because we have that 


JF [sin(wot)] = [F (e) — F (e7***)] /(21) (6.2.4) 
= m [d(w — wo) — (to + wo)] /i (6.2.5) 
= —qió(w — wo) + mió(w + wo) (6.2.6) 
and 
F [cos(wot)] = 3 [F (e*t) + F (e7*99*)] = m [6(w — wo) + 6(w + wo)]. (6.2.7) 


Note that although the amplitude spectra of sin(wot) and cos(wot) are the same, their phase 
spectra are different. 

Let us consider the Fourier transform of any arbitrary periodic function. Recall that 
any such function f(t) with period 2L can be rewritten as the complex Fourier series 


Ree (6.2.8) 
where wo = 7/L. The Fourier transform of f(t) is 
F(w) =F[f(t)] = DD 2Tcnôlw — nwo). (6.2.9) 


Therefore, the Fourier transform of any arbitrary periodic function is a sequence of impulses 
with weight 27c,, located at w = nwo with n = 0,1, 2, .... Thus, the Fourier series and 
transform of a periodic function are closely related. 
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e Example 6.2.1: Fourier transform of the sign function 


Consider the sign function 


qj: t0, 
sgn(t) — | 0, t=0, (6.2.10) 
—1, t « Q0. 


The function is not absolutely integrable. However, let us approximate it by e~‘!"!sen(t), 
where e is a small positive number. This new function is absolutely integrable and we have 
that 


0 oo 
-1 1 
F[sgn(t)| = lim -f gag t a+ f Ha m a — lim ( — + ) : 
c0 1366 0 «70 \€— WwW E+ 20 
(6.2.11) 
If w £ 0, Equation 6.2.11 equals 2/iw. If w = 0, Equation 6.2.11 equals 0 because 


lim (= + 3 =0. (6.2.12) 
e>0 € € 
Thus, we conclude that 
2/iw, w z 0, 
Kee us (6.213) 


e Example 6.2.2: Fourier transform of the step function 


An important function in transform methods is the (Heaviside) step function 


1, t0, 
H(t) — E Pau (6.2.14) 


In terms of the sign function it can be written 
H(t) = 4+ $sgn(t). (6.2.15) 


Because the Fourier transforms of 1 and sgn(t) are 27d(w) and 2/iw, respectively, we have 
that i 
F|H(t)| = rô(w) + —. (6.2.16) 
iw 
These transforms are used in engineering but the presence of the delta function requires 
extra care to ensure their proper use. 


Problems 
1. Show that the Fourier transform of a constant K is 27K d(w). 


2. Verify that 
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3. Verify that 


Fae = ha esa] 


ery: 
wó—w* 2 


4. Using the definition of Fourier transforms and Equation 6.2.16, show that 
i 


| e *** dt = 15(w) — —, or n et dt = mó(w) + a 
0 u 0 


W 


5. Following Example 6.2.1, show that 


2 2wi 
F (sgn(t) sin(wot)] = x and —— F[sgn(t) cos(wot)] = — = 2 
we — w we — w 


6.3 PROPERTIES OF FOURIER TRANSFORMS 


In principle we can compute any Fourier transform from its definition. However, it is 
far more efficient to derive some simple relationships that relate transforms to each other. 
This is the purpose of this section. 


| Linearity 


If f(t) and g(t) are functions with Fourier transforms F(w) and G(w), respectively, 
then 


Flaf(t) + cg(t)] = eF(w) +aG(w), (6.3.1) 


where cı and c2 are (real or complex) constants. 
This result follows from the integral definition 


Flas) estt] - f ^ [ef  esg(]e "tdt (6.8.2) 
=¢ J f(t)e dt + c Je g(t)e "tdt (6.3.3) 
= a F (w) + c&2G(w). (6.3.4) 


| Time shifting 


If f(t) is a function with a Fourier transform F(w), then F[f(t — 7)] = e~**7 F(w). 
This follows from the definition of the Fourier transform 


Flf(t—7r)| = I f(t- r)e “dt = E f (z)e-** 4) dg (6.3.5) 


— gie ri f(x)e "da = e 7 F(w). (6.3.6) 
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Figure 6.3.1: The amplitude and phase spectra of the Fourier transform for cos(2t) H(t) (solid line) and 
cos[2(t — 1) H(t — 1) (dashed line). The amplitude becomes infinite at w = £2. 


e Example 6.3.1 


The Fourier transform of f(t) = cos(at)H(t) is F(w) = iw/(a? — w°) + m[ó(w + a) + 
ô(w — a)|/2. Therefore, 


JF (cos[a(t — k) H (t — k)) = e^?" F[cos(at) H (t)], (6.3.7) 
5 de T oom ou 
F{cosla(t — k) H(t — k)) = dg 7 e“ (w +a) + 6(w — a)]. (6.3.8) 


In Figure 6.3.1 we present the amplitude and phase spectra for cos(2t) H(t) (the solid line) 
while the dashed line gives these spectra for cos[2(t — 1) H (t — 1). This figure shows that the 
amplitude spectra are identical (why?) while the phase spectra are considerably different. 


| Scaling factor 


Let f(t) be a function with a Fourier transform F'(w) and k be a real, nonzero constant. 
Then F[f(kt)] = F(w/k)/|k]. 
From the definition of the Fourier transform: 


F[f(kt)| = oz f(kt)e-™*dt = af. f(z)e egy = s) : (6.3.9) 


e Example 6.3.2 


The Fourier transform of f(t) = e * H(t) is F(w) = 1/(1 + wi). Therefore, the Fourier 
transform for f(at) = e ** H(t), a > 0, is 


F[f(at)) = (=) (x) = ur (6.3.10) 
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-10 -5 0 5 


10 


Figure 6.3.2: The amplitude and phase spectra of the Fourier transform for e-^H(t) (solid line) and 
e-?* H(t) (dashed line). 


To illustrate this scaling property we use the MATLAB script: 


clear; % clear all previous computations 

omega = [-10:0.01:10]; % set up frequencies 

^ real part of transform with a = 1 

fir omega = 1./(1*omega.*omega); 

^ imaginary part of transform with a = 1 

fii_omega = - omega./(1+omega.*omega) ; 

^4 real part of transform with a = 2 

f2r omega = 2./(4tomega. *omega) ; 

% imaginary part of transform with a = 2 

f2i omega = - omega./(4t+omega. *omega) ; 

^4 compute the amplitude of the first transform 

ampli = sqrt(fir omega.*fir omega + fii omega.*fii omega); 
^4 compute the amplitude of the second transform 

ampl2 - sqrt(f2r omega.*f2r omega * f2i omega.*f2i omega); 
4 compute phase of first transform 

phasel = atan2(fili omega,fir omega); 

^4 compute phase of second transform 

phase2 = atan2(f2i omega,f2r omega); 

clf; % clear all previous figures 

^4 plot amplitudes of Fourier transforms 

subplot(2,1,1), plot(omega,ampli,omega,ampl2,?--") 
ylabel(’|F(\omega)|’,’FontSize’,15) % label amplitude plot 
% plot phases of Fourier transforms 

subplot (2,1,2), plot (omega, phase, omega, phase2,’--’) 
ylabel(’phase’,’FontSize’,15) ^ label amplitude plot 
xlabel(’\omega’,’FontSize’,15) % label x-axis 


to plot the amplitude and phase when a = 1 and a = 2. Figure 6.3.2 shows the results 
from the MATLAB script: The amplitude spectra decreased by a factor of two for e7% H(t) 
compared to e H(t) while the differences in the phase are smaller. 
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| Symmetry 


If the function f(t) has the Fourier transform F(w), then F[F(t)] = 2r f(—w). 
From the definition of the inverse Fourier transform, 


f) = = T F(w)e™tdw = 3 AM F(a)e'* da. (6.3.11) 
Then 2 2m 
2r f(—w) = / F(z)e "dy = L F(t)e™™tdt = F|F(t)]. (6.3.12) 


— oo 


e Example 6.3.3 


The Fourier transform of 1/(1 + t?) is re™lel. Therefore, 


F (netti) -4 a or zem C" (6.3.13) 


+w? |l? 
| Derivatives of functions 


Let f(t), k = 0,1,2,...,n—1, be continuous and f) (t) be piecewise continuous. Let 
|f (£)) € Ke, b > 0,0 € t < oo; |f OH] € Me**,a > 0,-0o «t£ € 0,k —0,1,...,n. 
Then, F[f(”) (t)] = (iw)"F(w). 

We begin by noting that if the transform F[f’(t)] exists, then 


Fig = " į fine tdt = a D f' (t)e*[cos(w.t) — isin(wrt)] dt (6.3.14) 


= (—wi + iwr) I fte” [cos(wrt) — isin(w,t)] dt (6.3.15) 
= iw d fedt = iwF (w). (6.3.16) 

Finally, 
FISO E] = i F[f 790] = (wP FLFO™ )] = -= (iw) F(w). (6.3.17) 


e Example 6.3.4 
The Fourier transform of f(t) = 1/(1 + t?) is F(w) = ve-l*!. Therefore, 


"aee 


eTel, (6.3.18) 


= iwm7e ; Or F ( a 


1412)? 2 
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Q 


Figure 6.3.3: The (amplitude) spectrum of a rectangular pulse Equation 6.1.9 with a half width a — 10 
that has been modulated with cos(5t). 


| Modulation 


In communications a popular method of transmitting information is by amplitude mod- 
ulation (AM). In this process the signal is carried according to the expression f(t)e’”°*, 
where wo is the carrier frequency and f(t) is an arbitrary function of time whose amplitude 
spectrum peaks at some frequency that is usually small compared to wo. We now show that 
the Fourier transform of f(t)e^»* is F(w — wo), where F(w) is the Fourier transform of f(t). 


We begin by using the definition of the Fourier transform, or 
F| f(t) = / fee tdt = " f(the*—“o)tdt = F(w — wo). (6.3.19) 


Therefore, if we have the spectrum of a particular function f(t), then the Fourier transform 
of the modulated function f(t)e“°! is the same as that for f(t) except that it is now centered 
on the frequency wo rather than on the zero frequency. 


e Example 6.3.5 


Let us determine the Fourier transform of a square pulse modulated by a cosine wave 
as shown in Figures 6.3.3 and 6.3.4. Because cos(wot) = 3[e/** + e **"*] and the Fourier 
transform of a square pulse is F(w) = 2sin(wa)/w, 


Fife seg ew, ee (6.3.20) 


wW — Wo w + Wo 


Therefore, the Fourier transform of the modulated pulse equals one half of the sum of the 
Fourier transform of the pulse centered on wo and —wo. See Figures 6.3.3 and 6.3.4. 

In many practical situations, wo >> 7-/a. In this case we may treat each term as 
completely independent from the other; the contribution from the peak at w = wo has a 
negligible effect on the peak at w = —wy. 
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Figure 6.3.4: The (amplitude) spectrum of a rectangular pulse Equation 6.1.9 with a half width a — 10 
that has been modulated with cos(t/2). 
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Figure 6.3.5: The amplitude and phase spectra of the Fourier transform for e-?* H(t) (solid line) and 
e cos(4t) H(t) (dashed line). 


e Example 6.3.6 


The Fourier transform of f(t) = e" H(t) is F(w) = 1/(b + iw). Therefore, 


Fle~™ cos(at) H(t)] = $7 (ciate + e7iete-t?) (6.3.21) 
p Ti : rex ) (6.3.22) 
2\ b+ iw! ee b+ iw! Ls 
1 1 1 
2 3 3 iw) — ai T (b + iw) + z (6.3.23) 
F (6.3.24) 


We illustrate this result using e^? H (t) and e7% cos(4t) H(t) in Figure 6.3.5. 
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Figure 6.3.6: The (amplitude) spectrum |G(w)|/T of a frequency-modulated signal (shown top) when 
w1T = 2r and woT = 107. The transform becomes undefined at w = wo. 


e Example 6.3.7: Frequency modulation 


In contrast to amplitude modulation, frequency modulation (FM) transmits information by 
instantaneous variations of the carrier frequency. It can be expressed mathematically as 


exp i Fite f(r) dr+ic| e“ot where C is a constant. To illustrate this concept, let us find 
the Fourier transform of a simple frequency modulation 


| 0j Ut [t| < T/2, 
f(t) = { 0, l> 7/2, (6.3.25) 
and C = —w T/2. In this case, the signal in the time domain is 
t l e n T2 giuot. t« -T/2, 
g(t) = exp Gi f(r) dr + ic| er gato. —T/[2«t« T/2, (6.3.26) 
—oo eT /2 eiwot T/2 <t. 


We illustrate this signal in Figures 6.3.6 and 6.3.7. 
The Fourier transform of the signal G(w) equals 


—T/2 T/2 oo 
G(u) = e 7 f Supe / eater aye ar entra | TNR 
—oo —T/2 T/2 
(6.3.27) 
0 oo 9 
= pu ei(wo—w)t dt + d eilwo—w)t dt — pu ei(wo—w)t dt 
e 0 -T/2 
T/2 T/2 
" J cilwotwi—w)t gp — gian T/2 | eilo =o) dt, (6.3.28) 
—T/2 0 
Applying the fact that 
J etiot dt = rô(a) + 2, (6.3.29) 
o a 
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Figure 6.3.7: The (amplitude) spectrum |G(w)|/T of a frequency-modulated signal (shown top) when 
w1T = 8- and woT' = 10r. The transform becomes undefined at w = wọ. 


G(w) = 76(w — wo) QUT 4 gru + 


|grtsespium e Hm _ guste uA) 


[es ur PEU a ete 


(wo + w1 — w) 


i(wo — w) 


= 2nó(w — wo) cos(u4T/2) + 


20, sin|(w — wo — w1)T/2] l 


(6.3.30) 


E EE N (6.3.31) 


Figures 6.3.6 and 6.3.7 illustrate the amplitude spectrum for various parameters. In gen- 
eral, the transform is not symmetric, with an increasing number of humped curves as wT 


increases. 


| Parseval's equality 


In applying Fourier methods to practical problems we may encounter a situation where 
we are interested in computing the energy of a system. Energy is usually expressed by the 
integral [7 _ |f(t)|? dt. Can we compute this integral if we only have the Fourier transform 


of F(w)? 


From the definition of the inverse Fourier transform 


fit) = a | Foda, 


[ iota z f no f Poetas] a 


we have that 


(6.3.32) 


(6.3.33) 


Interchanging the order of integration on the right side of Equation 6.3.33, 


[. Vera af. FI ni feta du. 


(6.3.34) 
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However, as 
(w) = i f(te*dt. (6.3.35) 


Therefore, 


f] ora = f EOP ae, (6.3.36) 


— oo — oo 


This is Parseval’s equality? as it applies to Fourier transforms. The quantity |F(w)|? 
called the power spectrum. 


e Example 6.3.8 


In Example 6.1.1, we showed that the Fourier transform for a unit rectangular pulse 
between —a « t « a is 2sin(wa)/w. Therefore, by Parseval's equality, 


2 oo 4:2 a ein 
a sin“ (wa) w= f 12 dt — 2, T / CU eee (6.3.37) 


2 2 
W Ld W 


| Poisson’s summation formula 


If f(x) is integrable over (—oo, oo), there exists a relationship between the function and 
its Fourier transform, commonly called Poisson’s summation formula.® 
We begin by inventing a periodic function g(a) defined by 


Y f(x + 2nk). (6.3.38) 


k——oo 


Because g(x) is a periodic function of 27, it can be represented by the complex Fourier 
series: 


Y Cne, or 2) frk) = »» Cn: (6.3.39) 
n=—0o k——oo n-—-—oo 


Computing cn, we find that 


1 is —ina m 3 —inz 
Gc Ie je "* dz = P. D LA + 2kn)e '"* dx (6.3.40) 
= inr e int ur F(n) 
E + 2 e + 2kz)e- 7"? dx e f(x dz = >, (6.3.41) 


8 Apparently first derived by Rayleigh, J. W., 1889: On the character of the complete radiation at a 
given temperature. Philos. Mag., Ser. 5, 27, 460—469. 


9 Poisson, S. D., 1823: Suite du mémoire sur les intégrales définies et sur la sommation des séries. J. 


École Polytech., 19, 404—509. See page 451. 
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where F(w) is the Fourier transform of f(z). 


1. Linearity 


2. Complex conjugate 


3. Scaling 


4. Time shift 


5. Frequency translation 


6. Duality-time frequency 


7. Modulation 


8. Time differentiation 


9. Frequency differentiation 


10. Time integration 


11. Reversal 


12. Convolution in t 


13. Convolution in w 


side of Equation 6.3.39, we obtain 


or 


function, f(t) 


eif (t) + eag(t) 


FO 


fi(t) fo(t) 
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aF(w) + c3 G(w) 
F*(-w) 
F(w/a)/|o| 


ge E 


F(w — wo) 


anf (—w) 
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Fourier transform, F(w) 


$F (w + wo) + F(w — wo) 


(iw) F(w) 


in FO) (w) 


F'(w)/ (wi) + tF(0)d(w) 


F(—w) or F*(w) 
F\(w)Fo(w) 


FA(w) x Fo(w)/(27) 


» f(2rk) = > F(n) 
k=- n-—-—oo 
Y flak) - Y Fm). 
k——oo n-—-—oo 


Substituting Equation 6.3.41 into the right 


(6.3.42) 


(6.3.43) 
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e Example 6.3.9 


One of the popular uses of Poisson’s summation formula is the evaluation of infinite 
series. For example, let f(x) = 1/(a? + x”) with a real and nonzero. Then, F(w) = 
me—!l /|a| and 


& 1 jos d 1 M 
ee Ee — elal > |1+2 —-leln 6.3.44 
Saree Saag (ee) — € 
1 2 1 |a| 
= 14 = th , 6.3.4 
Jal ( =n) al °° (5) erem 
Problems 


1. Find the Fourier transform of 1/(1 + a?1?), where a is real, given that F[1/(1+ t?)] = 
-|el 
me ll, 


2. Find the Fourier transform of Jo(at), where a is real, given that F[Jo(t)] = 2H (1 — 


le) Via? 


3. Find the Fourier transform of 2[H (t — 3) — H (t — 11)], given Equation 6.2.16. Check your 
answer by performing a direct calculation using the definition of the Fourier transform. 


4. Find the Fourier transform of cos(at)/(1 + t?), where a is real, given that F[1/(1+#?)] = 
-|el 
me M, 


5. Use the fact that .F[e ^ H(t)] = 1/(a + iw) with a > 0 and Parseval’s equality to show 
that 
s dy vr 
œT? +a? a 
6. Use the fact that F[1/(1 + t?)] = xe- ^! and Parseval’s equality to show that 
L. dr = 
SEP 2 


7. Use the function f(t) = e7% sin(bt)H (t) with a > 0 and Parseval's equality to show that 


2 fo da: E T dx 7 T 
o (2? +a? — b?)2 4 4a2b2  J_ ~ (£2 +a? — 02)? --4a?b? — 2a(a? +b?) 


8. Using the modulation property and .F[e- H (t)] = 1/(b + iw), show that 


a 


F [e^ sin(at) H (t) = (Eau) at 


Use MATLAB to plot and compare the amplitude and phase spectra for e^ * H(t) and 
e 'sin(2t) H(t). 
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9. Use Poisson's summation formula with f(t) = e7!*! to show that 
2 —2m 


Y 1 l+e 
=T 
n? +1 1—e-?" 


10. Use Poisson’s summation formula to provel? that 


oo 


3 —a(n+c)?+2b(n+e) = T b? /a n?n? /a—2nmi(b/a—c) 
P fen xe | 


n=—Cco n=— Co 


11. Use Poisson’s summation formula to prove that 
oo 


5 quero ct Y (Rm a), 


where ó(-) is the Dirac delta function. 


. Prove the two-dimensional form** of Poisson's summation formula: 
12. P the two-d l fi 11 of P : t f l 


oo oo 


2 2 
Dg OU 


ki1—-—oo kg=—00 nj-—-—o00omn»-—-—oo 


Plein) = [| | pepet dedy, 


6.4 INVERSION OF FOURIER TRANSFORMS 


where 


Having focused on the Fourier transform in the previous sections, we now consider the 
inverse Fourier transform. Recall that the improper integral, Equation 6.1.6, defines the 
inverse. Consequently, one method of inversion is direct integration. 


e Example 6.4.1 


Let us find the inverse of F(w) = vel". 
From the definition of the inverse Fourier transform, 


] qe 1 f° 1 ger ; 
cus —|w| 5iwt rad (1+it)w aa (—1+it)w 
f(t) 3 J. me” edw sf dw + 5S e dw (6.4.1) 
1 e(t it)o 0 eC 1tit)w oo 1 1 1 1 
E : - - -|-—— (6.4.2) 
2| 1+it —1+it |o 2|l+it -—1l-c3t 1+t 


10 First proved by Ewald, P. P., 1921: Die Berechnung optischer und elektrostatischer Gitterpotentiale. 
Ann. Phys., 4te Folge, 64, 253-287. 


11 Lucas, S. K., R. Sipcic, and H. A. Stone, 1997: An integral equation solution for the steady-state 
current at a periodic array of surface microelectrodes. SIAM J. Appl. Math., 57, 1615-1638. 
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An alternative to direct integration is the MATLAB function ifourier. For example, 
to invert F(w) = te~!!, we type in the commands: 
>> syms pi omega t 
>> ifourier(’pixexp(-abs (omega) )’ ,omega,t) 
This yields 
ans = 
1/(1*t^2) 


Another method for inverting Fourier transforms is rewriting the Fourier transform 
using partial fractions so that we can use transform tables. The following example illustrates 
this technique. 


e Example 6.4.2 


Let us invert the transform 
1 


(1 + iw)(1 — 2iw)?” (6.4.3) 


F(w) = 


We begin by rewriting Equation 6.4.3 as 


DI 1 2 6 1 1 1 
F(w) = a + = +— ~— (6.4.4) 


9l1+iw 1-2iw (1—2iw)? Q1+iw) 9(i—iw) 6(5 — iw)? 


Using a table of Fourier transforms (see Section 6.1), we invert Equation 6.4.4 term by term 
and find that 


f(t) = ieH(t) + 1e? H(-t) — tte! H(—t). (6.4.5) 
To check our answer, we type the following commands into MATLAB: 

>> syms omega t 

>> ifourier(1/((1*i*omega)*(1-2*i*omega)^2) ,omega,t) 

which yields 

ans = 

1/9*exp(-t)*Heaviside(t)-1/6*exp(1/2*t)*t*Heaviside(-t) 
*1/9*exp(1/2*t)*Heaviside(-t) 


e Example 6.4.3: Numerical computation of the inverse Fourier transforms using MATLAB 


In Example 6.1.6 we showed how we can compute the Fourier transform of a temporal 
function f(t) by sampling at intervals of At. We performed the computations two ways: 
the trapezoidal rule and the fast Fourier transform. In this example we show how to use 
these two methods to numerically compute inverse Fourier transforms. In particular, we 
use the Fourier transform pair: 


2 
VI- a2 


'Turning to the trapezoidal methods first, we approximate the integral by replacing the 
limits from —oo to oo to one from —L to L: 


F[J(t)] = H(- |w|). (6.4.6) 


L 
f(t) © =f, Flw)ei™ dw, (6.4.7) 
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where L is a “large number” that will be specified later. The MATLAB code that yields f(t) 
is: 


clear 
N = 40; d_omega = 0.2; omega = [-N/2:N/2]*d_omega; ^ L = (N/2)*d_omega 


Ahhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh 
% Compute the Fourier transform X(omega) 


Ahhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh 


temp = 2 ./ sqrt(1-omega.*omega); 
for n = 1:length(omega) 

if abs(omega(n)) « 1 

X(n) = temp(n); % load in transform 
else 

X(n) = 

end; end 


hhhhhhhhhhhhhhhhhhhhhbhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhbhhhhhhhhhhhhh11p 
4 Perform the integration in Equation 6.4.7 


Ahhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh 


k = 0; 

for t = -40:dt:40 

k = k*1; 

tt(k) = t; 

xx(k) = trapz(omega,X.*exp(i*omega*t)); 
end 


x = real(xx) / (2*pi) % finally divide by 27 

Figure 6.4.1 illustrates the inversion of the Fourier transform using the trapezoidal rule 
for various Aw’s but the same L. Our code is not optimal because we have included w’s 
where F(w) = 0. However, I designed the code so that it could be used for any arbitrary 
Fourier transform. 

Looking at the figure closely, we note that numerical inversion lies between —T and T, 
where T = 2x / Aw and Aw is the size of our sampling of the transform F'(w). It is also most 
accurate for small |t|. An interesting artifact is the repetition of the numerical inversion 
in the intervals (3T, —T) and (T,3T) in the top frame. Here we are reminded that our 
numerical inverse is a Fourier series approximation of the Fourier transform. Only in the 
limit of Aw — 0 would we obtain the exact result. 

Let us now return to Equation 6.4.7 and apply the first-order extended rectangular 
rule to it. This yields 


Au ES ; 
OLET N^ Flum)”, (6.4.8) 
m-——M 


where wm = mAw and Aw = L/M. Although we could perform the summation in Equation 
6.4.8 for a given time t, let us examine the case when t = tn = «n/L, 


M-1 


fn = f (tn) Ry 5 Elone AE, (6.4.9) 


m=—M 
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0.5 


Figure 6.4.1: The numerical inversion of the Fourier transform F(w) = 2H(1— |w|)/W1—w? using the 
trapezoidal rule. In both frames the solid lines gives the exact inverse. In the top frame N = 40 and 
Aw = 0.2 (L = 4) while in the lower frame N = 160 and Aw = 0.05 (L = 4). 


i Aw es Ao E 
pU EC mimn/M ad mimn/M 
f. S S PL do 2 Fine (6.4.10) 


Invoking the periodicity condition F (wm) = F(wm+am), 


L 1 2M-—1 
Sree ag NO obti et PM (6.4.11) 
m=0 


The quantity within the square brackets is the inverse of the discrete Fourier transform. We 
see now why we choose to evaluate Equation 6.4.8 at t = tn; it can be rapidly computed. 
Equation 6.4.11 then yields the inverse for times 0 < tn < (2M — 1)x/L. For other times 
outside of this range, the periodicity condition gives fn = frtom. 

Returning to our test transform, we can program Equation 6.4.11 using MATLAB, our 
inversion scheme is: 


clear; L = 20; M = 64; d. omega = L / M; % d_omega = Aw 
for m = 1:2*M 

omega = -L + (m-1) * d omega; ^ compute wm 

if (abs(omega(m)) « 1) 

temp = 2 / sqrt(1-omega(m) *omega(m)) ; 

else 

temp = 0; 

end 
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hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhlhlhh lh 
Load in the transform 


Ahhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh 


if (omega(m) < 0) 
F(m+M) = temp; 
else 

F(m-M) = temp; 
end 

end 


Ahhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh 
^4 compute inverse of discrete Fourier transform 
Ahhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh 
f = ifft(F,2*M); % compute inverse of discrete Fourier transform 

We have special code for F(m) so that F(m) runs from m = 1 to m = 2M. To correctly 
order the computed values of f, so that they run from t = —Mm/L to (M — 1)a/L, we 
need 

for m = 1:2*M 

time(m) = pi * (m-1-M) / L; 

if (time(m) >= 0) 

fn(m) = L * real(f(m-M)) / pi; 

else 

fn(m) = L * real(f(m+M)) / pi; 

end; end 

Figure 6.4.2 shows the results when L — 20 for two different values of M. From this figure, 
the results are rather good even when the resolution is Aw — 0.3125. The best results occur 
at small |t]. 


Problems 


1. Use direct integration to find the inverse of the Fourier transform F(w) = iwme7!#!/2. 
Check your answer using MATLAB. 


Use partial fractions to invert the following Fourier transforms: 


1 1 

s (1 + iw)(1 + 2iw) * (1 + iw)(1 — iw) 
iw 1 

* (1 + iw)(1 + 2iw) 2 (1 + tw)(1 + 2iw)? 


Then check your answer using MATLAB. 
6.5 CONVOLUTION 


The most important property of Fourier transforms is convolution. We shall use it 
extensively in the solution of differential equations and the design of filters because it yields 
in time or space the effect of multiplying two transforms together. 
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Figure 6.4.2: The numerical inversion of the Fourier transform F(w) using Equation 6.4.11 with L = 20. 
The solid line gives the exact inverse while the dashed line corresponds to M = 64 while the dotted line 
gives the solution when M — 128. 


'The convolution operation is 


fo [^ fast as- | Fe- aas (6.5.1) 


Then, 
Fif@*xo@| = / ^ Haje | / B a(t ze tema ai (6.5.2) 
= T f(x)G(w)e dr = F(w)G(w). (6.5.3) 


Thus, the Fourier transform of the convolution of two functions equals the product of the 
Fourier transforms of each of the functions. 


e Example 6.5.1 


Let us verify the convolution theorem using the functions f(t) = H(t + a) — H(t — a) 
and g(t) = e^* H(t), where a > 0. 
The convolution of f(t) with g(t) is 


oo 


f) *g(t) = / e C-9 H(t — x) [H(a +a) - H(x — a)] dz = p e” H(t — x) dz. 


— oo —a 
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If t < —a, then the integrand of Equation 6.5.4 is always zero and f(t)» g(t) — 0. If t >a, 


f(t) * g(t) = gu e*da = e 6-9) — g- (+a), (6.5.5) 


—a 


Finally, for Ca «t <a, 


f(t) «g(t) = e= f e*dy = 1 — e709), (6.5.6) 
In summary, 
0, t< —a, 
f(t)«g(t 24 1-e “9, —a<t<a, (6.5.7) 
e (4-9) e-(t*9) act 


As an alternative to examining various cases involving the value of t, we could have 
used MATLAB to evaluate Equation 6.5.4. The MATLAB instructions are as follows: 


>> syms f t x 
>> syms a positive 
>> f = "?exp(x-t)*Heaviside(t-x)*(Heaviside(x*a)-Heaviside(x-a))? 
>> int(f,x,-inf,inf) 
This yields 
ans = 
Heaviside (t+a)-Heaviside(tta) *exp(-a-t) 
-Heaviside(t-a) +tHeaviside(t-a) *exp(a-t) 
The Fourier transform of f(t) * g(t) is 


i, [1 — ew +0) a at «f le Uu e ere e *"tgt (6.5.8) 


2sin(wa)  2isin(wa)  2sin(wa) 1 
1l-Fwi 


FIFE) * q(t)] 


II 


) = F(w)G(w) (6.5.9) 


w ltui Ww 


and the convolution theorem is true for this special case. The Fourier transform Equation 
6.5.9 could also be obtained by substituting our earlier MATLAB result into fourier and 
then using simplify (ans). 
e Example 6.5.2 

Let us consider the convolution of f(t) = f,(t)H(t) with g(t) = g, H(t). Note that 


both of the functions are nonzero only for t > 0. 
From the definition of convolution, 


Fo =f races GB) de [| finos G) de. (6.5.10) 
For t < 0, the integrand is always zero and f(t)» g(t) — 0. For t > 0, 


OxI = | Flt- 28.6)». (6.5.11) 
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Therefore, in general, 
t 
p) =| f He- 2) ae] o. (6.5.12) 


'This is the definition of convolution that we will use for Laplace transforms where all of the 
functions equal zero for t « 0. 


'The convolution operation also applies to Fourier transforms, in what is commonly 
known as frequency convolution. We now prove that 


Fifa = Ter en (6.5.18) 
where x 
F(w)* G(w) = i F(T)G(tw — 7) dr, (6.5.14) 


where F'(w) and G(w) are the Fourier transforms of f(t) and g(t), respectively. 


Proof: Starting with 


Te cp ; 
=> | Fre” 6.5.1 
f= 5 | Pedr, (6.5.15) 
we can multiply the inverse of F(T) by g(t) so that we obtain 
1 se f 
SOID =z | FOE ar. (6.5.16) 


Then, taking the Fourier transform of Equation 6.5.16, we find that 


FEE) e If. F(r)g(t)e** ar| e*t dt (6.5.17) 
= 5 a F(r) be se tema dr (6.5.18) 
-L i F(r)G(u — 7) dr = — ua (6.5.19) 


Thus, the multiplication of two functions in the time domain is equivalent to the convolution 
of their spectral densities in the frequency domain. 


e Example 6.5.3 


Let us find the convolution of H(t) with f(t). This convolution is 


H(t) « f(t) = ie f(r)H(t -T)dr = / f(r) dr. (6.5.20) 


Hence, 


F rs f(r) ar| = F(w)F[H(t)] = Fw) E + nsw) = re) - «F(0)5(w), (6.5.21) 
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where we have used Equation 6.2.16 and the property that f(t)ó(t) = f(0)d(t). 
Problems 
1. Show that e * H(t) «e * H(t) = te * H (t). Then verify your result using MATLAB. 
2. Show that e  H(t) x f H(—t) = 1e-*l. Then verify your result using MATLAB. 


3. Show that e^ H(t) « e? H(t) = (e^* — e-?'*) H(t). Then verify your result using 
MATLAB. 


4. Show that 
et En et? t< : 
éH(-t«[H()-H(t-2]-41-«-?, 0 <8 <2, 
0, 2 «f 
'Then verify your result using MATLAB. 
5. Show that 
0, t «x 0, 
t, 0<t<2, 
HO- BG -2)«(8(0- HG -2)- 47, gered 
0, 4 € t. 


'Then try and verify your result using MATLAB. What do you have to do to make it work? 
6. Show that e-!*l x e-!!l = (1 + [t])e- tl. 
7. Prove that the convolution of two Dirac delta functions is a Dirac delta function. 


6.6 THE SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS BY FOURIER TRANSFORMS 


We may use Fourier transforms to solve ordinary differential equations. However, this 
method gives only the particular solution and we must find the complementary solution 
separately. 

Consider the differential equation 


y ty = hel, —oo < t < oo. (6.6.1) 


Taking the Fourier transform of both sides of Equation 6.6.1, 


iwY (w) + Y (w) = (6.6.2) 


w2? +1 


where we used the derivative rule, Equation 6.3.17, to obtain the transform of y' and 
Y (w) = F[y(t)]. Therefore, 
1 


M LEE TER 


(6.6.3) 
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Applying the inversion integral to Equation 6.6.3, 


1 oo cito 1 oo cite 
(D- f c»rrs"-x.wrsscaro 15:69) 


Using partial fractions we find that 


: — | : pe (6.6.5) 
(w+i\(w—i)(1+wi) 4(1—wi)  2-cwif? © 4(1+wi)’ BS 


Using tables or MATLAB, term-by-term inversion yields 
y(t) = ie H(—t) + ite"! H(t) + fe" H(t), (6.6.6) 
which can be written more compactly as 
y(t) = ie! + ite"! H(t). (6.6.7) 


Note that we only found the particular or forced solution to Equation 6.6.1. The most 
general solution therefore requires that we add the complementary solution Ae *, yielding 


y(t) = Ae * + Fe“ + Ste H(t). (6.6.8) 


The arbitrary constant A would be determined by the initial condition, which we have not 
specified. 
We could also have solved this problem using MATLAB. The MATLAB script is: 


clear 

% define symbolic variables 

syms omega t Y 

% take Fourier transform of left side of differential equation 
LHS = fourier(diff (sym y(t)?))*sym C y (£2?) ,t, omega) ; 

^4 take Fourier transform of right side of differential equation 
RHS = fourier(1/2x*exp(-abs(t)),t,omega); 

4 set Y for Fourier transform of y 

^ and introduce initial conditions 

newLHS = subs(LHS, ’fourier(y(t),t,omega)’,Y); 

^4 solve for Y 

Y = solve(newLHS-RBHS,Y); 

^4 invert Fourier transform and find y(t) 

y = ifourier(Y,omega,t) 


yields 


y = 

1/4*exp(t) *Heaviside(-t)+1/2*exp(-t) *t*Heaviside(t) 
*1/4*exp(-t)*Heaviside(t) 

which is equivalent to Equation 6.6.7. 
Consider now a more general problem of 


y +y= ft), | -oo«t«oo, (6.6.9) 
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where we assume that f(t) has the Fourier transform F(w). Then the Fourier-transformed 
solution to Equation 6.6.9 is 


1 


Tu Im 


F(w) = G(w)F(w) or y(t) = g(t) * f (t), (6.6.10) 


where g(t) = F~+[1/(1 + wi)] = et H(t). Thus, we can obtain our solution in one of two 
ways. First, we can take the Fourier transform of f(t), multiply this transform by G(w), 
and finally compute the inverse. The second method requires a convolution of f(t) with 
g(t). Which method is easiest depends upon f(t) and g(t). 

In summary, we can use Fourier transforms to find particular solutions to differential 
equations. The complete solution consists of this particular solution plus any homogeneous 
solution that we need to satisfy the initial conditions. 


Problems 


Find the particular solutions for the following differential equations. Verify your solution 
using MATLAB. 


1. y" +3y'+2y=e *H(t) 2. y"+4y'+4y= ze ltl 3. y" — 4y' + 4y =e ! H(t) 


4. Assuming that the function g(x) possesses a Fourier transform, find the particular 
solution for the differential equation: 


y'—-y--g(x). 


Step 1: Take the Fourier transform of both sides of the differential equation and show that 


where Y (w) and G(w) are the Fourier transforms of y(x) and g(x), respectively. 


Step 2: Using tables, show that 


y(x) = e x glx) =e” ri e'g(t) dt + e* ju e *g(t) dt. 


5. (a) Consider the function f(x) = ie~!*!/(2X), where A is a complex number with a 
positive real part and a negative imaginary part. Using direct integration, show that the 
Fourier transform of f(x), F(w), is F(w) = 1/(A? — w?). 

(b) Using the results from part (a) and the table given in Section 6.1, find the particular 
solution to y^" — Aty = ó(z), where A has a positive real part and a negative imaginary 
part. 


6.7 THE SOLUTION OF LAPLACE’S EQUATION ON THE UPPER HALF-PLANE 


In this section we shall use Fourier integrals and convolution to find the solution of 
Laplace’s equation (see Chapter 10) on the upper half-plane y > 0. We require that the 
solution remains bounded over the entire domain and specify it along the x-axis, u(z,0) = 
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f(a). Under these conditions, we can take the Fourier transform of Laplace’s equation and 


find that 55 5d "P 
aoe dx + a dx = 0. (6.7.1) 


If everything is sufficiently differentiable, we may successively integrate by parts the first 
integral in Equation 6.7.1, which yields 
x Pu iwe dr = Ou —iwz 


Loo Ox? Ox 


FS ^? Ou 
d dw 


— oo 


€ *9*? de (6.7.2) 


Les 


= iw u(z, yje [7 — a f u(x, ye” dx (6.7.3) 


= —w*U(w, y), (6.7.4) 
where = 
U(w,y) = / u(x, ye *^* dz. (6.7.5) 
'The second integral becomes 
P. Fu —iwz d? m Wor PU(w, y) 


along with the boundary condition that 
F(w) = U(w,0) = y f(z)e *"* da. (6.7.7) 


Consequently, we reduced Laplace's equation, a partial differential equation, to an ordinary 
differential equation in y, where w is merely a parameter: 


d?U (c, y) 


T RN w?^U (w, y) = 0, (6.7.8) 
with the boundary condition U(w,0) = F(w). The solution to Equation 6.7.8 is 
U(w,y) = Alwe + B(w)e-l*lv, 9 « y. (6.7.9) 


We must discard the el!” term because it becomes unbounded as we go to infinity along 
the y-axis. The boundary condition results in B(w) = F(w). Hence, 


U (w,y) = F(w)e ll, (6.7.10) 


The inverse of the Fourier transform e~!“!¥ equals 


1 oo . 1 0 . 1 os j 
Qn / e lly ete du = — ee dw + — e "Ve"? dw (6.7.11) 
2c —oo 2n —o0o0 2m 0 
1 Bu —wy ,—iwcz 1 ^ —uy f iux 
== e “Ye dw + — e 4 en? dw (6.7.12) 
2c 0 2m 0 
1 oo 
= - | e *" cos(wax) dw (6.7.13) 
T Jo 
1 f exp(—wy) [—y cos(wa) + x sin(w2)] i (6.7.14) 
= g TE w xsin(wx A. 
"| 22-3? 2 " m 0 
1 
2 y (6.7.15) 


Tr? +y 
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Furthermore, because Equation 6.7.10 is a convolution of two Fourier transforms, its inverse 


1S 
E  yf&®) 
u(z,y) = E D GE dt. (6.7.16) 


Equation 6.7.16 is Poisson’s integral formula!” for the half-plane y > 0 or Schwarz’ integral 
formula? 


e Example 6.7.1 


As an example, let u(r,0) = 1 if |x| < 1 and u(z,0) = 0 otherwise. Then, 


1 ft y 1 1-z l-c-z 
= dt = —|tan7!( —— tan! f 71 
un y) 2E LE ( y )* i3 ( y ) ied) 


Problems 


Find the solution to Laplace’s equation ugg + Uyy = 0 in the upper half-plane for the 
following boundary conditions: 


1, O0ccc«1, HE : $0, 
fus ls otherwise. 2. u(z, 0) = z<0. 


To, «<0, 2To, z«-—1, 
3. u(z,0) = 4.u(r,0) —4 To,  —1«c«l, 
0, «>0. 0, 1«z. 
To, X «d, 
To, -1«z «0, Tlys SUE e d 
5. u(z,0) = E +(%-Th)z, O0«z«1, 6. u(x,0) = 4 12; a2 X? € as, 
0, otherwise. : : 


Tris An « dX. 


6.8 THE SOLUTION OF THE HEAT EQUATION 


We now consider the problem of one-dimensional heat flow (see Chapter 9) in a rod 
of infinite length with insulated sides. Although there are no boundary conditions because 
the slab is of infinite extent, we do require that the solution remains bounded as we go to 
either positive or negative infinity. The initial temperature within the rod is u(x,0) = f(x). 


1? Poisson, S. D., 1823: Suite du mémoire sur les intégrales définies et sur la sommation des séries. J. 


École Polytech., 19, 404—509. See pg. 462. 


13 Schwarz, H. A., 1870: Über die Integration der partiellen DifferentialgleichungO?u/Oz? +0?u/dy? = 0 
für die Flache eines Kreises. Vierteljahrsschr. Naturforsch. Ges. Zürich, 15, 113-128. 
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Employing the product solution technique of separation of variables (see Section 9.3), 
we begin by assuming that u(x,t) = X(x)T (t) with 


T" c a2AT — 0, (6.8.1) 


and 
X" FAX = 0. (6.8.2) 


Solutions to Equation 6.8.1 and Equation 6.8.2, which remain finite over the entire x- 
domain, are 
X(x) = E cos(kz) + F sin(kz), (6.8.3) 


and 
T(t) = C exp( - ? a?t). (6.8.4) 


Because we do not have any boundary conditions, we must include all possible values of 
k. Thus, when we sum all of the product solutions according to the principle of linear 
superposition, we obtain the integral 


u(x,t) = | [A(k) cos(ka) + B(k) sin(kz)]e-  * ' dk. (6.8.5) 
0 
We can satisfy the initial condition by choosing 


A(k) = 1 T BU (6.8.6) 


1 oo 
B(k) — JI f(a) sin(kx) dx, (6.8.7) 
T J—oo 
because the initial condition has the form of a Fourier integral 
Heja | [A(k) cos(kz) + B(k) sin(ka)] dk, (6.8.8) 
0 


when £ = 0. 
Several important results follow by rewriting Equation 6.8.8 as 


na f É | / : Y (Ey eos (he oos hn) d: / i ETENA a on Batt ap, 


(6.8.9) 
Combining terms, 


Ca ee L f E L B FB spe vane me E) aii ea ae hero dk — (6.8.10) 
- Ji if f(E) cos[k(€ — 2)] a e Fat gk. (6.8.11) 


Reversing the order of integration, 


jena es FE n cos(k(£ — seta d£. (6.8.12) 


T J—oo 
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The inner integral is called the source function. We may compute its value through an 
integration on the complex plane; it equals 


/ ” eos[k(é — 2)] exp(—Ka2) dk = (=) Tsa | =] , (6.8.13) 


if 0 < t. This gives the final form for the temperature distribution: 


diss Al. FE) op E] dé. (6.8.14) 


e Example 6.8.1 
Let us find the temperature field if the initial distribution is 
u(z,0) = { Tor. Aan (6.8.15) 


Then 
u(x,t) = R ap] d dé E ap- S2". ae} (6.8.16) 


T, & s T, x /2av/t 
— P. |/ er dt a / er ar| = = l ex dr (6.8.17) 
vm —z/2avt a/2avt vm -e[2avt 


2To x /2av/t 
VT Jo 


where erf(-) is the error function. 


-dr =T; e( E ) (6.8.18) 
€ T — To er ; .8. 
j 2av/t 


e Example 6.8.2: Kelvin’s estimate of the age of the earth 


In the middle of the nineteenth century, Lord Kelvin! estimated the age of the earth 
using the observed vertical temperature gradient at the earth’s surface. He hypothesized 
that the earth was initially formed at a uniform high temperature To and that its surface 
was subsequently maintained at the lower temperature of Ts. Assuming that most of the 
heat conduction occurred near the earth’s surface, he reasoned that he could neglect the 
curvature of the earth, consider the earth’s surface planar, and employ our one-dimensional 
heat conduction model in the vertical direction to compute the observed heat flux. 

Following Kelvin, we model the earth’s surface as a flat plane with an infinitely deep 
earth below (z > 0). Initially the earth has the temperature Tọ. Suddenly we drop the 
temperature at the surface to Ts. We wish to find the heat flux across the boundary at 
z = 0 from the earth into an infinitely deep atmosphere. 

The first step is to redefine our temperature scale v(z,t) = u(z,t) -- Ts, where v(z,t) is 
the observed temperature so that u(0,t) = 0 at the surface. Next, in order to use Equation 


14 Thomson, W., 1863: On the secular cooling of the earth. Philos. Mag., Ser. 4, 25, 157-170. 
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6.8.14, we must define our initial state for z « 0. To maintain the temperature u(0, t) — 0, 
the initial temperature field f(z) must be an odd function, or 


= To — Ts, z>0, 
Oe ve e Oh (6.8.19) 


From Equation 6.8.14, 


we = BBL fog SP] ae f* es [- ES ae} (eaa 
= (h - Ts) at( 2). (6.8.21) 


following the work in the previous example. 
The heat flux q at the surface z = 0 is obtained by differentiating Equation 6.8.21 
according to Fourier's law and evaluating the result at z — 0: 


Ov 


= k(Ts — To) 
Oz 


z-—0 i art l 
The surface heat flux is infinite at t = 0 because of the sudden application of the temperature 


Ts at t = 0. After that time, the heat flux decreases with time. Consequently, the time t 
at which we have the temperature gradient Ov(0, t)/0z is 


q=- (6.8.22) 


co y= Tay 
t= x 0v(0,0/0s]* prog 


For the present near-surface thermal gradient of 25 K/km, Tọ — Ts = 2000 K, and a? = 1 
mm?/s, the age of the earth from Equation 6.8.23 is 65 million years. 

Although Kelvin realized that this was a very rough estimate, his calculation showed 
that the earth had a finite age. This was in direct contradiction to the contemporary 
geological principle of uniformitarianism: that the earth’s surface and upper crust had 
remained unchanged in temperature and other physical quantities for millions and millions 
of years. The resulting debate would rage throughout the latter half of the nineteenth 
century and feature such luminaries as Kelvin, Charles Darwin, Thomas Huxley, and Oliver 
Heaviside.!° Eventually Kelvin's arguments would prevail and uniformitarianism would 
fade into history. 

'Today, Kelvin's estimate is of academic interest because of the discovery of radioactivity 
at the turn of the twentieth century. During the first half of the twentieth century, geologists 
assumed that the radioactivity was uniformly distributed around the globe and restricted to 
the upper few tens of kilometers of the crust. Using this model they would then use observed 
heat fluxes to compute the distribution of radioactivity within the solid earth.!ó Now we 
know that the interior of the earth is quite dynamic; the oceans and continents are mobile 
and interconnected according to the theory of plate tectonics. However, geophysicists still 
use measured surface heat fluxes to infer the interior!” of the earth. 


15 See Burchfield, J. D., 1975: Lord Kelvin and the Age of the Earth. Science History Publ., 260 pp. 
16 See Slichter, L. B., 1941: Cooling of the earth. Bull. Geol. Soc. Am., 52, 561-600. 


17 Sclater, J. G., C. Jaupart, and D. Galson, 1980: The heat flow through oceanic and continental crust 
and the heat loss of the earth. Rev. Geophys. Space Phys., 18, 269-311. 
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e Example 6.8.3 


So far we have shown how a simple application of separation of variables and the 
Fourier transform yields solutions to the heat equation over the semi-infinite interval (0, oc) 
via Equation 6.8.5. Can we still use this technique for more complicated versions of the 
heat equation? The answer is yes but the procedure is more complicated. We illustrate it 
by solving!? 

Ou ou 20u 


= H .8.24 
ot^ "angi + © Bq? 0«r«oo 0<t, (6.8.24) 

subject to the boundary conditions 
u(0,t) = f(t), lim |u(z, t)| < oo, 0 « t, (6.8.25) 

1 
lim u(x,t) > 0, lim us(z,t) > 0, 0 « t, (6.8.26) 
and the initial condition 

u(z,0) = 0, 0 « z « oo. (6.8.27) 


We begin by multiplying Equation 6.8.24 by sin(kx) and integrating over x from 0 to 


af Uter sin(kx) dx + è f Ure sin(ka) dz = J uz sin(kz) dz. (6.8.28) 
0 0 0 


Next, we integrate by parts. For example, 


| Ure Sin(ka) dx = u,sin(kv)| — kf us cos(kax) dx (6.8.29) 
0 0 0 
= - f us cos(kx) dx (6.8.30) 
0 


= —ku(z,t) cos(kx) 


— k? a x,t) sin(ka) dx 8. 
] wansin(keyde (68.31) 
= kf(t) — k?U(k, 1), (6.8.32) 


where m 
U(k,t) = J u(x, t) sin(kz) dz, (6.8.33) 
0 


and the boundary conditions have been used to simplify Equation 6.8.29 and Equation 
6.8.31. Equation 6.8.33 is the definition of the Fourier sine transform. It and its math- 
ematical cousin, the Fourier cosine transform do u(x,t) cos(ka) dz, are analogous to the 
half-range sine and cosine expansions that appear in solving the heat equation over the 
finite interval (0, L). The difference here is that our range runs from 0 to oo. 

Applying the same technique to the other terms, we obtain 


alk f' (t) — &?U'(k,t)] + a? |kf (t) — k°U(k, t)] = U'(k,t) (6.8.34) 


18 See Fetecáu, C., and J. Zierep, 2001: On a class of exact solutions of the equations of motion of a 
second grade fluid. Acta Mech., 150, 135-138. 
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with U(k,0) = 0, where the primes denote differentiation with respect to time. Solving 
Equation 6.8.34, 


t 2 t 
e^ k t/U+akDU (k t) = ok ] rte nmhas ES a'k ] etras, 
0 0 


1+ ak? 1+ ak? 
(6.8.35) 
Using integration by parts on the second integral in Equation 6.8.35, we find that 
1 2,2 2 1 t 2,2 2 
Bil = o —a^k^t/(lcoak^) . | 4 —a^k^(t—T)/(1--ak )d . 
U(t) = gro - rov ror | fe : 
(6.8.36) 
Because 9 [9 
u(x,t) = F U (k, t) sin(kx) dk, (6.8.37) 
7T Jo 


"TE ? r(r ja ENS dk 


OO E. t 
A T sin(kz) 2 2/0 ak?) gp [o+ J fae eva 
T Jo m 


k 14+ ak? 
(6.8.38) 
2 f°sin(ka) _ 2k2t/(1+ak?) 1 n ?k? 7 /(1tak?) 
E _4 SIn WL) à a ete te oe a T a d 1 
ra- t dk (0) aus [0 r 
(6.8.39) 


Problems 


For Problems 1—4, find the solution of the heat equation 
Ou 2 07u 
Suh pe, 
Ot Ox?’ 


subject to the stated initial conditions. 


—oo«mr«oo, 0<t, 


1. u(x, 0) = i E 2 2 2. u(z,0) = etl 
0, —oo«mrz« 0, 

3. u(x, 0) = { 0<a<b, 4. u(a,0) = o(x) 
0, b< z<. 


Lovering!? has applied the solution to Problem 1 to cases involving the cooling of lava. 


5. Solve the spherically symmetric equation of diffusion,?° 


ðu (u 20u 
En “(ss ) 0zr«oo, Oct, 


r Or 


19 Lovering, T. S., 1935: Theory of heat conduction applied to geological problems. Bull. Geol. Soc. 
Am., 46, 69—94. 


20 See Shklovskii, I. S., and V. G. Kurt, 1960: Determination of atmospheric density at a height of 430 
km by means of the diffusion of sodium vapors. Am. Rocket Soc. J., 30, 662—667. 
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with u(r,0) = uo(r). 


Step 1: Assuming v(r,t) = r u(r,t), show that the problem can be recast as 


with v(r, 0) = r uo(r). 


Step 2: Using Equation 6.8.14, show that the general solution is 


usto oom wfe] ed ew CEPE), pap. 


Hint: What is the constraint on Equation 6.8.14 so that the solution remains radially 
symmetric? 


Step 3: For the initial concentration of 


No, 0 € r « ro, 
wt) = { o. To «T : 


show that 


ueo = ime) er) e (o a] -eof e]: 


where erf(-) is the error function. 


Further Readings 


Bracewell, R. N., 2000: The Fourier Transform and Its Applications. McGraw-Hill Book 
Co., 616 pp. This book presents the theory as well as a wealth of applications. 


Körner, T. W., 1988: Fourier Analysis. Cambridge University Press, 591 pp. Presents 
several interesting applications. 


Sneddon, I. N., 1995: Fourier Transforms. Dover, 542 pp. A wonderful book that illustrates 
the use of Fourier and Bessel transforms in solving a wealth of problems taken from the 
sciences and engineering. 


Titchmarsh, E. C., 1948: Introduction to the Theory of Fourier Integrals. Oxford University 
Press, 391. A source book on the theory of Fourier integrals until 1950. 


Taylor & Francis 
Taylor & Francis Group 


http://taylorandfrancis.com 
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Chapter 7 
The Laplace Transform 


'The previous chapter introduced the concept of the Fourier integral. If the function is 
nonzero only when t > 0, a similar transform, the Laplace transform,' exists. It is particu- 
larly useful in solving initial-value problems involving linear, constant coefficient, ordinary, 
and partial differential equations. The present chapter develops the general properties and 
techniques of Laplace transforms. 


7.1 DEFINITION AND ELEMENTARY PROPERTIES 


Consider a function f(t) such that f(t) = 0 for t < 0. Then the Laplace integral: 


L[f(t)] = F(s) = = fFe dt (7.1.1) 


defines the Laplace transform of f(t), which we shall write C[f(t)) or F(s). The Laplace 
transform converts a function of t into a function of the transform variable s. 

Not all functions have a Laplace transform because the integral, Equation 7.1.1, may 
fail to exist. For example, the function may have infinite discontinuities. For this reason, 
f(t) = tan(t) does not have a Laplace transform. We can avoid this difficulty by requiring 
that f(t) be piece-wise continuous. That is, we can divide a finite range into a finite number 
of intervals in such a manner that f(t) is continuous inside each interval and approaches 
finite values as we approach either end of any interval from the interior. 


1 The standard reference for Laplace transforms is Doetsch, G., 1950: Handbuch der Laplace- Trans- 
formation. Band 1. Theorie der Laplace- Transformation. Birkhauser Verlag, 581 pp.; Doetsch, G., 1955: 
Handbuch der Laplace- Transformation. Band 2. Anwendungen der Laplace- Transformation. 1. Abteilung. 
Birkhàuser Verlag, 433 pp.; Doetsch, G., 1956: Handbuch der Laplace- Transformation. Band 3. Anwen- 
dungen der Laplace- Transformation. 2. Abteilung. Birkháuser Verlag, 298 pp. 
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Another unacceptable function is f(t) — 1/t because the integral Equation 7.1.1 fails 
to exist. This leads to the requirement that the product t"|f(t)| is bounded near t = 0 for 
some number n « 1. 

Finally, | f(t)| cannot grow too rapidly or it could overwhelm the e^5* term. To express 
this, we introduce the concept of functions of exponential order. By exponential order we 
mean that there exist some constants, M and k, for which |f(t)| € Me* for all t > 0. 
Then, the Laplace transform of f(t) exists if s, or just the real part of s, is greater than k. 

In summary, the Laplace transform of f(t) exists, for sufficiently large s, provided f(t) 
satisfies the following conditions: 


e f(t) — 0 for t « 0, 
e f(t) is continuous or piece-wise continuous in every interval, 
e ("|f (t)| < oo as t > 0 for some number n, where n < 1, 


e e 8") F(t)| < oo as t — oo, for some number so. The quantity so is called the abscissa 
of convergence. 


e Example 7.1.1 


Let us find the Laplace transform of 1, e*’, sin(at), cos(at), and t” from the definition 
of the Laplace transform. From Equation 7.1.1, direct integration yields 


oo 


oo —st 1 
£(1) =f e-**dt = — P (7.1.2) 
0 S 0 S 
£(e**) =| ee dt =| pret (7.1.3) 
0 0 
—(s—a)t |? 1 
nase = | s>a, (7.1.4) 
s—a h s-a 

oo e oo 
L{sin(at)] = n sin(at)e *'dt = — ———— [ssin(at) + a cos(at)] (7.1.5) 

0 s^-J-a 0 

a 

= age s>0, (7.1.6) 

oo EL oo 
L{cos(at)| -f cos(at)e dt = apal cos(at) + a sin(at)] , (7.1.7) 

s 
= go age s > 0, (7.1.8) 
and 
L(t") = T. t^e “dt =nle~* Y nee m. >0 (7.1.9) 
= A € = n.e a (n —m)!s™+1 " we grt? S , ll. 


where n is a positive integer. 
MATLAB provides the routine laplace to compute the Laplace transform for a given 
function. For example, 
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>> syms ans t 

>> laplace(1,t,s) 

ans = 

1/s 

>> laplace(exp(a*t) ,t,s) 
ans = 

1/(s-a) 

>> laplace(sin(a*t),t,s) 
ans = 

a/(s^2*a^2) 

>> laplace(cos(a*t),t,s) 
ans = 

s/(s^2*a^2) 

>> laplace(t^5,t,s) 

ans = 

120/s^6 


'The Laplace transform inherits two important properties from its integral definition. 
First, the transform of a sum equals the sum of the transforms, or 


Lie f(t)  e29(t)] = eic [f(0)]  ezc [o (t)]. (7.1.10) 


'This linearity property holds with complex numbers and functions as well. 
e Example 7.1.2 


Success with Laplace transforms often rests with the ability to manipulate a given 
transform into a form that you can invert by inspection. Consider the following examples. 


Given F(s) = 4/s?, then 


2 
F(s) 22x —, and = f(t) = 2 (7.1.11) 
E 
from Equation 7.1.9. 
Given E à 
E 8 
F(s\)= = | 1.12 
(s) s82+1 8+1 8241’ g ) 
then 
f(t) = cos(t) + 2sin(t) (7.1.13) 
by Equation 7.1.6, Equation 7.1.8, and Equation 7.1.10. 
Because 1 j 1 
F(s) = = (7.1.14) 


s(s-1) s-l s 


by partial fractions, then 
ft)2e-1 (7.1.15) 
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by Equation 7.1.2, Equation 7.1.4, and Equation 7.1.10. 
MATLAB also provides the routine ilaplace to compute the inverse Laplace transform 
for a given function. For example, 


>> syms s t 

>> ilaplace(4/s^3,s,t) 

ans - 

2*t^2 

>> ilaplace((s+2)/(s*2+1),s,t) 
ans = 

cos(t)+2*sin(t) 

>> ilaplace(1/(s*(s-1)),s,t) 
ans = 

-1+exp(t) 


The second important property deals with derivatives. Suppose f(t) is continuous and 
has a piece-wise continuous derivative f'(t). Then 


Zu T Fedt = tO + f fe “dt (7.1.16) 


by integration by parts. If f(t) is of exponential order, e 5f (t) tends to zero as t + oo, for 
large enough s, so that £[f'(t)] = sF(s) — f(0). Similarly, if f(t) and f’(t) are continuous, 
f" (t) is piece-wise continuous, and all three functions are of exponential order, then 


Lif" ©] = sE[f' (£)] — £'(0) = s? F(s) — sf(0) — f"(0). (7.1.17) 


In general, 


£[f (0 = s F() - s"? f(0) — «= sf-?(0) — f"-9(9) (7.1.18) 


on the assumption that f(t) and its first n—1 derivatives are continuous, f™ (t) is piece-wise 
continuous, and all are of exponential order so that the Laplace transform exists. 
'The converse of Equation 7.1.18 is also of some importance. If 


u(t) = ji f(r) dr, (7.1.19) 


then 


ze wn fueecst fue 
f e meje-- f 


and 


oo 1 oo 
«s f(te "dt, 
0 $ Jo 
(7.1.20) 


£ | » i f(r) ar| = F(s)/s, (7.1.21) 
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where u(0) — 0. 
Problems 


Using the definition of the Laplace transform, find the Laplace transform of the following 
functions. For Problems 1-4, check your answers using MATLAB. 


1. f(t) = cosh(at) 2. f (t) = cos? (at) 
3. f(t) = (t 1)? 4. f(t) = (t4- De-*t 
sQ-iy Cre On a” 


Using your knowledge of the transform for 1, e**, sin(at), cos(at), and t”, find the Laplace 
transform of 


7. f (t) = 2sin(t) — cos(2t) + cos(3) — t 8. f(t) 2t — 2+ e^?! — sin(5t) + cos(2). 
Find the inverse of the following transforms. Verify your result using MATLAB. 
9. F(s) 2 1/(s +3) 10. F(s) = 1/s* 


11. F(s) =1/(s? + 9) 12. F(s) = (2s +3)/(s? + 9) 


13. F(s) = 2/(s? +1) — 15/s? + 2/(s +1) — 6s/(s? + 4) 


14. F(s) = 3/s + 15/s? + (s + 5)/(s? + 1) — 6/(s — 2). 
15. Verify the derivative rule for Laplace transforms using the function f(t) — sin(at). 
16. Show that L[f(at)] = F (s/a) /a, where F(s) = £[f(t)]. 


17. Using the trigonometric identity sin?(a) = [1 — cos(2a)|/2, find the Laplace transform 
of f(t) = sin?[t/(2T))]. 


7.2 THE HEAVISIDE STEP AND DIRAC DELTA FUNCTIONS 
Change can occur abruptly. We throw a switch and electricity suddenly flows. In this 


section we introduce two functions, the Heaviside step and Dirac delta, that will give us the 
ability to construct complicated discontinuous functions to express these changes. 


| Heaviside step function 


We define the Heaviside step function as 


H(t—a)= is S (7.2.1) 
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Largely a self-educated man, Oliver Heaviside (1850-1925) lived the life of a recluse. It was during 
his studies of the implications of Maxwell’s theory of electricity and magnetism that he re-invented 
Laplace transforms. Initially rejected, it would require the work of Bromwich to justify its use. 
(Portrait courtesy of the Institution of Engineering and Technology Archives.) 


where a > 0. From this definition, 


oo —as 


£[H (t — a)] =| e"dt=— sg > 0. (7.2.2) 


a S 


Note that this transform is identical to that for f(t) = 1 if a = 0. This should not surprise 
us. As pointed out earlier, the function f(t) is zero for all t < 0 by definition. Thus, 
when dealing with Laplace transforms, f(t) = 1 and H(t) are identical. Generally we will 
take 1 rather than H(t) as the inverse of 1/s. The Heaviside step function is essentially a 
bookkeeping device that gives us the ability to “switch on” and “switch off” a given function. 
For example, if we want a function f(t) to become nonzero at time t = a, we represent this 
process by the product f(t)H(t — a). On the other hand, if we only want the function to 
be “turned on" when a < t < b, the desired expression is then f(t)|H(t — a) — H(t — b)]. 
For t < a, both step functions in the brackets have the value of zero. For a « t « b, the 
first step function has the value of unity and the second step function has the value of zero, 
so that we have f(t). For t > b, both step functions equal unity so that their difference is 
Zero. 


e Example 7.2.1 
Quite often we need to express the graphical representation of a function by a math- 


ematical equation. We can conveniently do this through the use of step functions in a 
two-step procedure. The following example illustrates this procedure. 
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Figure 7.2.1: Graphical representation of Equation 7.2.5. 


Consider Figure 7.2.1. We would like to express this graph in terms of Heaviside step 
functions. We begin by introducing step functions at each point where there is a kink 
(discontinuity in the first derivative) or jump in the graph—in the present case at t = 0, 
t—1,t—2, and t = 3. These are the points of abrupt change. Thus, 


f(t) = ao(t)H(t) + ai (0)H(t — 1) + ax (t) H(t — 2) + as(£) H(t — 3), (7.2.3) 


where the coefficients ao(t), a1(t), ... are yet to be determined. Proceeding from left to right 
in Figure 7.2.1, the coefficient of each step function equals the mathematical expression 
that we want after the kink or jump minus the expression before the kink or jump. As 
each Heaviside turns on, we need to add in the new t behavior and subtract out the old t 
behavior. Thus, in the present example, 


f(t) = (t—0)H(t) + (A—0H(t—1)-- (3—1t) - 11H(t — 2) + [0 — (3 — €)|H(t — 3) (7.2.4) 


or 


f(t) 2 tH(t) — (t - 2H(t—1)— (t- 2) H(t — 2) + (t - 3) H(t — 3). (7.2.5) 


We can easily find the Laplace transform of Equation 7.2.5 by the “second shifting" 
theorem introduced in the next section. 


e Example 7.2.2 


Laplace transforms are particularly useful in solving initial-value problems involving 
linear, constant coefficient, ordinary differential equations where the nonhomogeneous term 
is discontinuous. As we shall show in the next section, we must first rewrite the nonhomo- 
geneous term using the Heaviside step function before we can use Laplace transforms. For 
example, given the nonhomogeneous ordinary differential equation: 


" 7 _ Jt, 0<t<1, 
y +3y += (8 1 «t, (7.2.6) 


we can rewrite the right side of Equation 7.2.6 as 


y” + 3y + 2y 2t - EH(t- 1) =t— (t 1) H(t 1) - A(t—1). (7.2.7) 


In Section 7.7 we will show how to solve this type of ordinary differential equation using 
Laplace transforms. 
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The Laplace Transforms of Some Commonly Encountered Functions 


f(t), t>0 F(s) 
1 
1 s s 
s 
1 
2 eat n 
sta 
1 
3. a Lem) s(s +a) 
1 
BY AT 
i exerce) (sca) +0) 
E 
5: gta (be — ae“) FEST IPS 
6. sin(at) E: — 
E 
7. cos(at) 2 22 
sta 
8. sinh(at) 2 - 2 
s?—4 
E 
9. cosh(at) Pray) 
. 2as 
10. t sin(at) (s2 + a2)? 
2d 
11. 1 — cos(at) s(s? + a2) 
. a? 
12. at — sin(at) s?(s? + a2) 
3215718 
13. t cos(at) (52 + a2)2 
2 3 
14. sin(at) — at cos(at) (s? - 2)2 
s2 +a 
2 
15. tsinh(at) (s? xm 
2.1552 
16. t cosh(at) c m 
' 2a? 
17. at cosh(at) — sinh (at) (s? — a2)? 
s?—a 
18. e^" sin(at) (s+ y 1532 
b 
19. e ot cos(at) (s Ts + a2 
3,2 
20. (1+ at?) sin(at) — at cos(at) as 
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The Laplace Transforms of Some Commonly Encountered Functions (Continued) 


f(t), t>0 F(s) 
l ; 4a? 
21. sin(at) cosh(at) — cos(at) sinh(at) 54 4 4al 
2a?s 
22. sin(at) sinh(at) 54 4 4g4 
2a? 
23. sinh(at) — sin(at) P NE: 
2a?s 
24. cosh(at) — cos(at) s4 — g4 
m a sin(at) — bsin(bt) xc s? 
"A (s? + a2)(s? + 2) 
Bs bsin(at) — asin(bt) > p 1 
f a 
a Corer 
cos(at) — cos(bt) > , 19 2 
27. EX uu 
7 b2 — a2 a # (s? + a?)(s? + b?) 
! 
28. tn >0 E 
grr 
n—1,-—at 
29. ULP C ! 
(n- 1) cd 
30. (n= 1) = af ca car n1 ° 
CERT (s +a)” 
n! 
31. Peh, n> 0 (stayrtt 
iene (s +a)”+! 
n4n— (1/2) 
m 2^ € g- ine a/2 
1-3-5- (2n — 1) m 
1 
33. Jolat VsF a? 
o(at) Vs? + a? 
1 
34, Ip (at) a: 
35 = ext( Vat) 
. = — EF a 
Ja sys+a 


36. uum dated an) v — z 


1 2 1 
37. —— — ae" 'erfc(av/t — 
vat a a+ Vs 

1 


38. e" erfc(v/at ) 


es (naim J/s—a—-vs—b 


39. 
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The Laplace Transforms of Some Commonly Encountered Functions (Continued) 


f(t), t» 0 F(s) 
1 
40. —— + ae” terf(a vt) T 
Tt s—a 
1 E 
41. ——e (1 4- 2at 
nt ( ) (s—a)/s—a 
1 2 — 1 
42. =e" terf(avt 
Qe e (avt) CET ORE 
43. L eat a >0 e72vas 
Tt’ 
1 1 
44. — ett a> (3 ajas 
mend ,a20 dee 
1 
45 t ( 2) „a> 0 Ze as 
t E 
t a? a e evs 
46. 24/— —— | —a erfc| —- > ——— 
6 "Ls x) a edte( 5), ao US 
—a 8 
b?t--ab a Le a betys 
AT. —e erfe(bv/t + zx) erfe( t.) ,a>0 SE JO 
" —av/s 
48. abe bt «(i beg). >0 oS 
ee? terfe| bv i a> ERN 
Notes: " 
Error function: erf(x) = = i ew dy 


Complementary error function: erfc(x) = 1 — erf (x) 


| Dirac delta function 


The second special function is the Dirac delta function or impulse function. We define 
it by 


o0, t=a, sm u 
ó(t — a) = { 0, Er f ó(t — a) dt — 1, (7.2.8) 
where a > 0. 
A popular way of visualizing the delta function is as a very narrow rectangular pulse: 
a ete oie 1/e, 0 « [t — a| < e/2, 
a= imd 0, |t — al > €/2, (29) 


where € > 0 is some small number and a > 0. See Figure 7.2.2. This pulse has a width 
€, height 1/e, and its center at t = a so that its area is unity. Now, as this pulse shrinks 
in width (e — 0), its height increases so that it remains centered at t = a and its area 
equals unity. If we continue this process, always keeping the area unity and the pulse 
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A — Ae iP ee 


S(t) 


1/€ 


Figure 7.2.2: The Dirac delta function. 


symmetric about t = a, eventually we obtain an extremely narrow, very large amplitude 
pulse at t = a. If we proceed to the limit, where the width approaches zero and the height 
approaches infinity (but still with unit area), we obtain the delta function ó(t — a). 

'The delta function was introduced earlier during our study of Fourier transforms. So 
what is the difference between the delta function introduced then and the delta function 
now? Simply put, the delta function can now only be used on the interval [0, oo). Outside 
of that, we shall use it very much as we did with Fourier transforms. 

Using Equation 7.2.9, the Laplace transform of the delta function is 


oo 1 ate/2 
£[o(t — a)] = f ó(t — a)e dt = lim — edi (7.2.10) 
0 €30 € a—e/2 

con. E (ace = grae (7.2.11) 

c0 ES 

Nd es | eg es eg 

= li 14 He- — 1 Ee 7.2.12 
«30 es ( 278 *3 8 ) ( ) 
=e“, (7.2.13) 


In the special case when a = 0, £[o(t)] = 1, a property that we will use in Section 7.7. 
Note that this is exactly the result that we obtained for the Fourier transform of the delta 
function. 

If we integrate the impulse function, 


t 
0, t<a, 
f ó(r — a) dr = { o (7.2.14) 


according to whether the impulse does or does not come within the range of integration. 


This integral gives a result that is precisely the definition of the Heaviside step function, so 
that we can rewrite Equation 7.2.14: 


ri ó(r — a) dr = H(t — a). (7.2.15) 
0 
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Consequently, the delta function behaves like the derivative of the step function, or 


E [ma = 2 = ô(t — a). (7.2.16) 


Because the conventional derivative does not exist at a point of discontinuity, we can only 
make sense of Equation 7.2.16 if we extend the definition of the derivative. Here we extended 
the definition formally, but a richer and deeper understanding arises from the theory of 
generalized functions.? 


e Example 7.2.3 


Let us find the (generalized) derivative of 


f(t) = 3? (H(t) - H(t — 1). (7.2.17) 
Proceeding formally, 
f'(t) = et[H (t) - H(t — 1)] + 3t? [6(t) — ó(t — 1)] (7.2.18) 
= 6t [H (t) — H(t — 1) 4- 0 — 3ó(t — 1) (7.2.19) 
= 6t [H (t) — H(t — 1)] — 3ó(t — 1), (7.2.20) 


because f (t)ó(t — to) = f(to)d(t — to). 


e Example 7.2.4 


MATLAB also includes the step and Dirac delta functions among its intrinsic functions. 
'There are two types of step functions. In symbolic calculations, the function is Heaviside 
while step function is used in numerical calculations. For example, the Laplace transform 
of Equation 7.2.5 is: 


>>syms s,t 

>>laplace(’t-(t-1) *Heaviside(t-1)-(t-2)*Heaviside(t-2)’... 
?+(t-3) *Heaviside(t-3)’,t,s) 

ans = 

1/s^2-exp(-s)/s^2-exp(-2*s)/s^2*exp(-3*s)/s^2 
Ina similar manner, the symbolic function for the Dirac delta function is Dirac. There- 

fore, the Laplace transform of (t — 1)0(t — 2) is: 

>>syms s,t 

>>laplace(’ (t-1)*Dirac(t-2)’,t,s) 

ans = 

exp (-2*s) 


? The generalization of the definition of a function so that it can express in a mathematically correct 
form such idealized concepts as the density of a material point, a point charge or point dipole, the space 
charge of a simple or double layer, the intensity of an instantaneous source, etc. 
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Problems 


Sketch the following functions and express them in terms of the Heaviside step functions: 


0, 0«t«a 

0; Osts2 1, a «t« 2a 

1. f(t) 24 t—2, 2xt«3 2. f(t) = E Du t< 3a 
0, oe 0, 3a « t 


Rewrite the following nonhomogeneous ordinary differential equations using the Heaviside 
step functions: 


PENDET 
s eae { pus ey +a taeu CI 
9. y + ux om 10. ew ed ues P y 


7.3 SOME USEFUL THEOREMS 


Although at first sight there would appear to be a bewildering number of transforms 
to either memorize or tabulate, there are several useful theorems, that can extend the 
applicability of a given transform. 


| First shifting theorem 


Consider the transform of the function e~ f(t), where a is any real number. Then, by 
definition, 


Lie FOS if C entera f(t)dt = I * en (sta)t f(t) dt, (7.3.1) 
Lle-* fE] = F(s +a). (7.3.2) 


That is, if F(s) is the transform of f(t) and a is a constant, then F(s + a) is the transform 


ore F(a): 
e Example 7.3.1 


Let us find the Laplace transform of f(t) = e7% sin(bt). Because the Laplace transform 
of sin(bt) is b/(s? + b?), 
b 


L [e*t sin(bt)] = leta) pp 


(7.3.3) 
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where we simply replaced s by s + a in the transform for sin(bt). 


e Example 7.3.2 


Let us find the inverse of the Laplace transform 


s+2 


F(s) = cT (7.3.4) 
Rearranging terms, 
F(s) = Ea __ 5+2 __ eS 1 22 _ (7.3.5) 
s2 +6s+1 (s+3)?—8 (s+3) -8 2/2(s+3}-8 
Immediately, from the first shifting theorem, 
f(t) =e * cosh (2v) - £ afi — sinh (2V3). (7.3.6) 


| Second shifting theorem 


The second shifting theorem states that if F(s) is the transform of f(t), then e~°* F(s) 
is the transform of f(t — 0) H (t — b), where b is real and positive. To show this, consider the 
Laplace transform of f(t — b) H(t — b). Then, from the definition, 


E£|f(t — b) H(t - b) = P f(t — b) H(t — b)e-** dt (7.3.7) 

z: f(t — b)e s dt = d € P5e^5* f(x) dz (7.3.8) 

=e? E e^? f(x) dx (7.3.9) 

d £[f(t — b) H(t — b) = e Pe F(s), (7.3.10) 


where we set x = t — b. This theorem is of fundamental importance because it allows us to 
write down the transforms for “delayed” time functions. That is, functions that “turn on” 
b units after the initial time. 


e Example 7.3.3 


Let us find the inverse of the transform (1 — e~*)/s. Since 


= (7.3.11) 


p G = =) cp (i) EE (=) SHR Hte), (7.3.12) 
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because £C 1(1/s) = f(t) =1, and f(t — 1) — 1. 


e Example 7.3.4 


Let us find the Laplace transform of f(t) = (t? — 1)H (t — 1). 
We begin by noting that 


(? — 1H(t— 1) = [(t— 1-- 1? - 1]H(t — 1) (7.3.13) 
= [t - 1? + 2(t - 1)|H(t — 1) (7.3.14) 
= (t- 1? H(t — 1) --2(t - 1)H(t - 1). (7.3.15) 


A direct application of the second shifting theorem then leads to 


EH pude eR (7.3.16) 


s? s2 


e Example 7.3.5 


In Example 7.2.2 we discussed the use of Laplace transforms in solving ordinary differ- 
ential equations. One further step along the road consists of finding Y (s) = £[y(t)]]. Now 
that we have the second shifting theorem, let us do this. 

Continuing Example 7.2.2 with y(0) = 0 and y'(0) = 1, let us take the Laplace trans- 
form of Equation 7.2.7. Employing the second shifting theorem and Equation 7.1.18, we 
find that 


s?Y (s) — sy(0) — y'(0) + 3sY (s) — 3y(0) + 2Y (s) = PL dn (7.3.17) 
Substituting in the initial conditions and solving for Y (s), we finally obtain 
1 1 Se =B 
Y(s) = £ £ . (7.3.18) 


(sd UD. ^ spo. FEIDER ^ sen 0641) 


Laplace transform of t” f (t) 


In addition to the shifting theorems, there are two other particularly useful theorems 
that involve the derivative and integral of the transform F(s). For example, if we write 


F(s) = Lif(t)] = I ” f(fe-*dt (7.3.19) 


and differentiate with respect to s, then 


F'(s)= T —tf(t)e-*'dt = —c|[tf(t)]. (7.3.20) 


0 
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In general, we have that 
FC? (s) = (IPLE f(t)]. (7.3.21) 


Laplace transform of f (t)/t 


Consider the following integration of the Laplace transform F(s): 


l F(z) dz = i ra feat dz. (7.3.22) 


Upon interchanging the order of integration, we find that 


[ream [ro [f ejas- [1077 


a= [ FE sn. 
s 0 t 


(7.3.23) 
Therefore, 
f F(z)dz =£ [£] : (7.3.24) 
e Example 7.3.6 
Let us find the transform of tsin(at). From Equation 7.3.20, 
: d . | d a a 2as 
L{t sin(at)] = - 5 { cisim} Peas E z | EC (7.3.25) 


e Example 7.3.7 


Let us find the transform of [1 — cos(at)]/t. To solve this problem, we apply Equation 


7.3.24 and find that 
Fea Eae =} L[1 — cos(at)] ae = f : 2 -|de (7.3.26) 
fp ey , z 2+4? 
= (E) (7.3.27) 


t 
s Vz? + a? E 


= In(z) - 4 ln(z? + a?) 


= In(1) 


| Initial-value theorem 


Let f(t) and f’(t) possess Laplace transforms. Then, from the definition of the Laplace 
transform, 


»( ==) z in( ——2) (7.3.28) 


n ^ f'(te-* dt = sF(s) — f(0). (7.3.29) 
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Because s is a parameter in Equation 7.3.29 and the existence of the integral is implied by 
the derivative rule, we can let s — oo before we integrate. In that case, the left side of 
Equation 7.3.29 vanishes to zero, which leads to 


lim sF(s) — f(0). (7.3.30) 


S—00 


This is the initial-value theorem. 
e Example 7.3.8 


Let us verify the initial-value theorem using f(t) = e®’. Because F(s) = 1/(s — 3), 
lims s/(s — 3) = 1. This agrees with f(0) = 1. 


In the common case when the Laplace transform is a ratio of two polynomials, we 
can use MATLAB to find the initial value. This consists of two steps. First, we construct 
sF(s) by creating vectors that describe the numerator and denominator of sF(s) and then 
evaluate the numerator and denominator using very large values of s. For example, in the 
previous example, 

»»num - [1 0]; 
>>den = [1 -3]; 
>>initialvalue = polyval(num,1e20) / polyval(den,1e20) 
initialvalue - 
1 


| Final-value theorem 


Let f(t) and f'(t) possess Laplace transforms. Then, in the limit of s + 0, Equation 
1.3.29 becomes 


jn f'(t) dt = lim | f'(r)dr = lim f(t) — f(0) = lim sF (s) — f(0). (7.3.31) 
0 0 


t—oo t—oo s—0 


Because f(0) is not a function of t or s, the quantity f(0) cancels from Equation 7.3.31, 
leaving 
Jm f(t)- lim sF(s). (7.3.32) 
Equation 7.3.32 is the final-value theorem. It should be noted that this theorem assumes 
that lim; ,49 f(t) exists. For example, it does not apply to sinusoidal functions. 
In the case when f(t) is a periodic function with a period T, Gluskin? showed that 


lim sF(s) = = f (t) dt. (7.3.33) 


3 Gluskin, E., 2003: Let us teach this generalization of the final-value theorem. Eur. J. Phys., 24, 
591—597 
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e Example 7.3.9 
Let us verify the final-value theorem using f(t) = t. Because F(s) = 1/s?, 
lim sF(s) = lim 1/s = oc. (7.3.34) 
The limit of f(t) as t — oo is also undefined. 


Just as we can use MATLAB to find the initial value of a Laplace transform in the case 
when F(s) is a ratio of two polynomials, we can do the same here for the final value. Again 
we define vectors num and den that give sF (s) and then evaluate them at s = 0. Using the 
previous example, the MATLAB commands are: 


>>num = [0 1 0]; 
>>den = [1 0 0]; 
>>finalvalue = polyval(num,0) / polyval(den,0) 
Warning: Divide by zero. 
finalvalue = 
NaN 


This agrees with the result from a hand calculation and shows what happens when the 
denominator has a zero. 


e Example 7.3.10 


Looking ahead, we will shortly need to find the Laplace transform of y(t), which is 
defined by a differential equation. For example, we will want Y(s) where y(t) is governed 
by 

y" + 2y' + 2y = cos(t) + ô(t — 7/2), y(0) = y'(0) =0. (7.3.35) 


Applying Laplace transforms to both sides of Equation 7.3.35, we have that 
L(y”) + 2L(y’) + 2L(y) = £[cos(t)] + L[6(t — n/2)], (7.3.36) 
E 


s2? +1 
Substituting for y(0) and y'(0) and solving for Y (s), we find that 


s?Y (s) — sy(0) — y'(0) + 2sY (s) — 2y(0) + 2Y (s) = +e., (7.3.37) 


s e 37/2 


Y(s) = H . 
(s) (s?+1)(s?+2s4+2) s?425+2 


(7.3.38) 


Presently this is as far as we can go. 
How would we use MATLAB to find Y(s)? The following MATLAB script shows you 
how: 


clear 

% define symbolic variables 

syms pis t Y 

^4 take Laplace transform of left side of differential equation 

LHS = laplace(diff(diff(symC y(t)?))) 42*diff(symC y(t)?)) ... 
+2*sym(’y(t)’)); 

^ take Laplace transform of right side of differential equation 
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RHS = laplace(cos(t)+’Dirac(t-pi/2)’,t,s); 

% set Y for Laplace transform of y 

y, and introduce initial conditions 

newLHS = subs(LHS,’laplace(y(t),t,s)’,’y(0)’,’D(y) (0), Y,0,0); 
^ solve for Y 

Y = solve(newLHS-RBHS,Y) 

It yields 

Y= 
(stexp(-1/2*pi*s)*s^2texp(-1/2*pi*s))/(s^443*s^242*s^342*s842) 


Problems 


Find the Laplace transform of the following functions and then check your work using 
MATLAB. 


1. f(t) = e™ sin(2t) 2. f(t) = e ?' cos(2t) 

3. f(t) 2 & H(t — 1) 4. f(t) = e* H(t — 3) 

5. f(t) = te’ + sin(3t)e* + cos(5t)e?t 6. f(t) = t*e-?! + sin(3t)e* + cos(4t)e?t 
7. f(t) = tet + sin(2t)e! + cos(3t)e~** 8. f(t) 2 ? H(t - 1) - e! H(t —2) 


9. f(t) 2 (? + 2)H(t — 1) - H(t — 2) 10. f(t) = (t - 1? H(t — 1) +e’ H(t — 2) 
11. f(t) de? sin(2t) 12. f(t) = e'[1 — cosh(t)] 
13. f(t) = oe E 7 14. f(t) = E : js 2 


Find the inverse of the following Laplace transforms by hand and using MATLAB: 


15. Fs) = c I6. F() = gg 

17. F(s) = 31313 18. F(s) = "ME 
ism (s is s2 er 2 29 ae (s 2)? | s? I$ 2 
21. F(s) = c v3 +5 UI - 22. Fs) aa 

28. F(s) = cos 24. F(s) = 5 5— 

25. F(s) = a 26. F(s) = A ! — 

27. F(s) = 34 Les P > 28. F(s) = — + E 


29. Find the Laplace transform of f (t) = te'*|H(t—1)— H (t—2)] by using (a) the definition of 
the Laplace transform, and (b) a joint application of the first and second shifting theorems. 


314 Advanced Engineering Mathematics with MATLAB 


30. Write the function 
t, O0<t<a, 


(o - [5 Gxt, 


in terms of Heaviside’s step functions. Then find its transform using (a) the definition of 
the Laplace transform, and (b) the second shifting theorem. 


In Problems 31-34, write the function f(t) in terms of the Heaviside step functions and then 
find its transform using the second shifting theorem. Check your answer using MATLAB. 


t, 0<t<1 
T UE e 02.) = [1 1<t<2 
0, 2<t 0, dud 
0, 0<t<1 
5 Osts2 t—1, 1<t<2 
33. f(t)=<4-t, 2<t<4 34. f(t) = 1 ee 
0 4«t i Ste? 
f T 0, 3<t 


Find Y (s) for the following ordinary differential equations and then use MATLAB to check 
your work. 


35. y" + 3y' + 2y = H(t — 1); y(0) = y'(0) 20 
36. y" + Ay = 3H (t — 4); y(0) 21, y'(0) 20 

3T. y" + Ay! + Ay = tH (t — 2); y(0) 20, y'(0) 22 
38. y" + 3y' + 2y = e! H(t — 1); y(0) = y'(0) =0 


39. y" — 3y' + 2y = e ! H (t — 2); y(0) = 2, y'(0) 20 


40. y” — 3y' +2y 2 CH(t-1) — y(0) =0, y'(0)—5 
41. y" +y = sin(t)|1l — H(t — «)]; y(0) = y/(0) 20 
42. y" + 3y! + 24y = t + [ae- 79 — t| H(t — a); y(0) = y'(0) = 0. 


For each of the following functions, find its value at t = 0. Then check your answer using 
the initial-value theorem by hand and using MATLAB. 


43. f(t) 2 t 44. f(t) = cos(at) 
45. f(t) = 1e^* 46. f(t) = e' sin(3t) 
For each of the following Laplace transforms, state whether you can or cannot apply the 


final-value theorem. If you can, find the final value by hand and using MATLAB. Check 
your result by finding the inverse and finding the limit as t > oo. 


4T. F(s) — PET 48. F(s) = : 
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1 E 


49. F(s) - 5 


2 2 


53. Using the fact that 


show? that 


1 . asc 1 1 e" : bn d 
X = X 
s A s +b E o $Tb PS +b b 
if x > 0. Therefore, using the fact? that 
t v/2 
al ea kd = (2) I, (2Vat ) : R(v) > —1, 
a 
and the first shifting theorem, show 
1 ax 
E^ |zew(- oe ) =1- ou e" I (2 2j) dn, 
E s+b 0 


where J,,(-) is a modified Bessel function of the first kind and order v introduced in Section 
12.2. 


7.4 THE LAPLACE TRANSFORM OF A PERIODIC FUNCTION 


Periodic functions frequently occur in engineering problems and we shall now show how 
to calculate their transform. They possess the property that f(t +T) = f(t) for t > 0 and 
equal zero for t < 0, where T is the period of the function. 

For convenience, let us define a function x(t) that equals zero except over the interval 
(0, T) where it equals f(t): 


= ~F@y 0<t<T, 
x(t) = { 0, Tet. (7.4.1) 
By definition, 
oo T 2T (k+1)T 
— et = —st —st eee —st eee 
F(s)= f f(t)e a= f f(t)e "dt + : f(t)e *'dt + «f. f(t)e ro 


Now let z = t — kT, where k = 0,1,2,..., in the kth integral and F(s) becomes 


T T T 
F(s)= f fG)e tas | Flat Tct D aes, | f(z - kD)e-*6**D qz ..., 
(7.4.3) 


^ Liaw, C. H., J. S. P. Wang, R. A. Greenkorn, and K. C. Chao, 1979: Kinetics of fixed-bed absorption: 
A new solution. AICHE J., 25, 376-381. 


5 Watson, E. J., 1981: Laplace Transforms and Applications. Van Nostrand Reinhold Co., p. 195. 
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However, 
z(z)-—f(z)-f(z-T)-...—f(zT-kT)-—..., (7.4.4) 


because the range of integration in each integral is from 0 to T. Thus, F(s) becomes 


T T T 
F(s) — n z(z)e ?* dz + d a(zje** dz+-+++ ger x(z)e ?? dz+--- (7.4.5) 
0 0 0 


or 


F(s) - (1 | est i e72sT | ce PST 4...) X(s). (7.4.6) 


The first term on the right side of Equation 7.4.6 is a geometric series with common ratio 
e-3T, If |e-5T| < 1, then the series converges and 


__X(s) (7.4.7) 


e Example 7.4.1 


Let us find the Laplace transform of the square wave with period T: 


f(t) = { 2 i (7.4.8) 


By definition x(t) is 


h, 0<t<T/2, 
a(t)=4 —-h,  T/2«t«T, (7.4.9) 
0, T « t. 
Then 
oo T/2 T 
X(s) = Í z(t)e-* dt = f he™* dt + s (—h) e^*! dt (7.4.10) 
2 
rz h —sT/2 —sTY _ h —sT/2 : 
= = (1-2 +e j= (1-e ) l (7.4.11) 
and 


hiag nte" Ae) 
s(1— esT) ^ s(14e-sT/2) 


F(s) = (7.4.12) 


If we multiply numerator and denominator by exp(sT/4) and recall that tanh(u) = (e” — 
e ")/(e" + e^), we have that 


F(s) = = tan E) (7.4.13) 
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e Example 7.4.2 


Let us find the Laplace transform of the periodic function 


| f sin(2rt/T), 0<t<T/2, 
f(t)— { 0, T/2<t<T. (7.4.14) 
By definition x(t) is 
. J sin(2at/T), 0<t<T/2, 
x(t) = { 0, T/2 x t (7.4.15) 
Then T 
2nt 22T 
X(s) = in| —— | e^ * dt = ————— (1 RE : 7.4.16 
(s) | sin( T ) e 7 4s +e ( ) 
Hence, 
X(s) QnT 146-977? QnT 1 
Seen ead ioe Fee ae ) 
Problems 


Find the Laplace transform for the following periodic functions: 


1. f(t) = sin(t), O<t<T, f(t) = f(t+7) 

TE 215^ t= 10420 

IOAN on, f(t) = f( + 2a) 
1, 0<t<a, 

Lg gol. — Qujefüdbta) 
0, 3a « t « 4a, 


7.5 INVERSION BY PARTIAL FRACTIONS: HEAVISIDE'S EXPANSION THEOREM 


In the previous sections, we devoted our efforts to calculating the Laplace transform 
of a given function. Obviously, we must have a method for going the other way. Given a 
transform, we must find the corresponding function. This is often a very formidable task. 
In the next few sections we shall present some general techniques for the inversion of a 
Laplace transform. 

'The first technique involves transforms that we can express as the ratio of two poly- 
nomials: F(s) = q(s)/p(s). We shall assume that the order of q(s) is less than p(s) and 
we have divided out any common factor between them. In principle we know that p(s) has 
n zeros, where n is the order of the p(s) polynomial. Some of the zeros may be complex, 
some of them may be real, and some of them may be duplicates of other zeros. In the case 
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when p(s) has n simple, nonrepeating roots (zeros), a simple method exists for inverting 
the transform. 
We want to rewrite F(s) in the form: 


F(s) = LET NEL MEN IMMO NEL. OT ats), (7.5.1) 
8—81  8—89 S— sn pls) 
where s1, 52,...,8n are the n simple zeros of p(s). We now multiply both sides of Equation 
7.5.1 by s — sı so that 
E E NN Cd QN (7.5.2) 
p(s) S — $2 S— Sn 


If we set s = sı, the right side of Equation 7.5.2 becomes simply aı. The left side takes 
the form 0/0 and there are two cases. If p(s) = (s — s1)g(s), then aı = q(s1)/g(s1). If we 
cannot explicitly factor out s — sı, l'Hópital's rule gives 


(s — 51)q(s) (s—51)d (s) - a(s) | a(s1) 


zm = i = : 7.5.3 
"COEM og) 5 GS) v (s) oM 
In a similar manner, we can compute all of the coefficients az, where k = 1,2,..., m. 
Therefore, 
£ '[F()] = £^ ES eg ( ME poe aue om ) (7.5.4) 
p(s) 8—8, S-S? S — Sn 
= a4 691 + age®?* +--+» + au ent, (7.5.5) 


This is Heaviside’s expansion theorem, applicable when p(s) has only simple zeros. 
e Example 7.5.1 
Let us invert the transform s/[(s -- 2)(s? +1)]. It has three simple zeros at s = —2 and 


s = +i in the denominator. From our earlier discussion, q(s) = s, p(s) = (s + 2)(s? + 1), 
and p'(s) = 3s? + 4s +1. Therefore, 


à lc 4 He + 5] c E i To xd + e ies = + D wey) 
= -fet eg - "ier - rri BEST) 
= -fe ti g ae eae) 
= Ser : sin(t) 4 : aod); (7.5.9) 

where we used sin(t) = 4: (e** — e~**), and cos(t) = 4 (e”* + e ^**). 


e Example 7.5.2 


Let us invert the transform 1/[(s—1)(s—2)(s—3)]. There are three simple zeros in the 
denominator: s; = 1, s2 = 2, and s3 = 3. In this case, the easiest method for computing 


a1, Q5, and ag is 
—1 1 
à; = lim 2 = (7.5.10) 
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s—2 
=N =-1 7.5.11 
az = lim De-ale , (7.5.11) 
and s i 
am 
S -5 5.12 
-a GONG 3 (7.5.12) 
Therefore, 
= 1 m " a" 
cue ! | = Let — e% + lg (7.5.1 
6356-3] j F ue ee e (ee c0 dE 3) 


Note that for inverting transforms of the form F(s)e **? with a > 0, you should use 
Heaviside's expansion theorem to first invert F(s) and then apply the second shifting the- 
orem. 

Let us now find the expansion when we have multiple roots, namely 


ante) s d(s) 
F(s) — p(s) = (s — 81)" (s = s2)™2 RS (s = 54)" (7.5.14) 


where the order of the denominator, m; + M2 + -> + Mn, is greater than that for the 
numerator. Once again we eliminated any common factor between the numerator and 
denominator. Now we can write F(s) as 


n Mk 
= ) D l akj 
k=1 j=1 


Multiplying Equation 7.5.15 by (s — s,)™*, 


(s — sx)"^a(s) 


= akı + aka(s — Sk) +- +4 bacca) nel 
p(s) 
— Mk Q11 Ix EE Onmy TE 
t (s Sk) ao | 1 mae ; ( 5. ) 


where we grouped together into the square-bracketed term all of the terms except for those 
with aj; coefficients. Taking the limit as s > sx, 


(s = si)" ras). 


= li 7.5.17 
aan c ES — ps) G 
Let us now take the derivative of Equation 7.5.16, 
d | (s — sy)" *q(s Wii. 
( ny als) = apg + 2ays(s — sy) +--+ (my — l)agm, (s — sy) ^? 
ds p(s) 
d a11 Anm 
— — us e] Z ; 7.5.18 
ZI sk) pans eM ( ) 
Taking the limit as s > s, 
d |(s — sk)"*q(s) 
=] : 7.5.19 
ak2 ferri ds | p(s) ( ) 
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In general, 
1 dit [(s- sp)” 
akj = lim — = [eee quy]. (7.5.20) 
oe G— Ids | p(s) 
and by direct inversion, 
n Mk 
akj Mi=} pSkt 
t= — —— $F e&t. 7.5.21 
m-Y3 tts ran 
J= 
e Example 7.5.3 
Let us find the inverse of 
E 
F(s) = ———————. 7.5.22 
9) = G339 67 1) ( ) 
We first note that the denominator has simple zeros at s = +7 and a repeated root at 
s = —2. Therefore, 
A B C D 
F(s) = 7.5.23 
(s) s—i sci s+2 (s+2)? ( ) 
where 
A= lim (s= $)F(s) = sig: (7.5.24) 
B= lim (sc i)F(s) = slg, (7.5.25) 
soi 
: d 2 : d 8 008 
C= Jim ale + 2) Fo) = Jim, J; (a T ;) —-—35 (7.5.26) 
and 
D= lim, (s+ 2? F(s) 2 -2. (7.5.27) 
s—>— 
Thus, 
JO = p taat age O te o a eos) + g sint) e.t pte. 
(7.5.28) 
Let us now find the inverse of 
race + (ca-wd) | cs + (ca — wd) | (7.5.29) 
(sca)? +w? (s+a—wi)(s+atut) 
by Heaviside’s expansion theorem. Then 
j — di c + d2e®i /c2 + dae 9i 
P eec E E S (7.5.30) 


2(s+a—wi) 2(s+a+wi) 2X(s+a-—wi) 2(s+a+wi)’ 


where 0 = tan™!(d/c). Note that we must choose 0 so that it gives the correct sign for c 
and d. 
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Taking the inverse of Equation 7.5.30, 
f(t) = 1c! Fe tte p 1/92 ett = ye + de cos(wt+0). (7.5.31) 


Equation 7.5.31 is the amplitude/phase form of the inverse of Equation 7.5.29. It is partic- 
ularly popular with electrical engineers. 


e Example 7.5.4 


Let us express the inverse of 


8s—3 


F(s) = ————— .9.32 
Oir mE TEXT SES) 
in the amplitude/phase form. 
Starting with 
— 4 4- 19i 4 — 19i 
F(s) = e E ten xd | ue (7.5.33) 
(s+2—3i)(s+2+3i) s4+2-3i 854243: 
1017¢38-3675°% 1017¢—38-3675°% 
EE 017e 4:9 017e id (7.5.34) 
84-2—3i s+2+3i 
or 
f(t) - 5.1017e- 2¢ + 3% +38.3675° 4 2 5.1017e- 2t-3it—38.3675* i (7.5.35) 
= 10.2034e 7” cos(3t + 38.3675°). (7.5.36) 


e Example 7.5.5: The design of film projectors 


For our final example we anticipate future work. The primary use of Laplace transforms 
is the solution of differential equations. In this example we illustrate this technique that 
includes Heaviside's expansion theorem in the form of amplitude and phase. 

This problem? arose in the design of projectors for motion pictures. An early problem 
was ensuring that the speed at which the film passed the electric eye remained essentially 
constant; otherwise, a frequency modulation of the reproduced sound resulted. Figure 
7.5.1(A) shows a diagram of the projector. Many will remember this design from their days 
as a school projectionist. In this section we shall show that this particular design filters out 
variations in the film speed caused by irregularities either in the driving-gear trains or in 
the engagement of the sprocket teeth with the holes in the film. 

Let us now focus on the film head—a hollow drum of small moment of inertia J;. See 
Figure 7.5.1(B). Within it there is a concentric inner flywheel of moment of inertia J2, 
where Jz > Jı. The remainder of the space within the drum is filled with oil. The inner 
flywheel rotates on precision ball bearings on the drum shaft. The only coupling between the 
drum and flywheel is through fluid friction and the very small friction in the ball bearings. 


6 Cook, E. D., 1935: The technical aspects of the high-fidelity reproducer. J. Soc. Motion Pict. Eng., 
25, 289-312. 
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Figure 7.5.1: (A) The schematic for the scanning light in a motion-picture projector and (B) interior of 
the film drum head. 


The flection of the film-loops between the drum head and idler pulleys provides the spring 
restoring force for the system as the film runs rapidly through the system. 

From Figure 7.5.1 the dynamical equations governing the outer case and inner flywheel 
are (1) the rate of change of the outer casing of the film head equals the frictional torque 
given to the casing from the inner flywheel plus the restoring torque due to the flection of 
the film, and (2) the rate of change of the inner flywheel equals the negative of the frictional 
torque given to the outer casing by the inner flywheel. 

Assuming that the frictional torque between the two flywheels is proportional to the 
difference in their angular velocities, the frictional torque given to the casing from the inner 
flywheel is B(w2—w 1), where B is the frictional resistance, w; and wg are the deviations of the 
drum and inner flywheel from their normal angular velocities, respectively. If r is the ratio 
of the diameter of the winding sprocket to the diameter of the drum, the restoring torque 
due to the flection of the film and its corresponding angular twist equals d (rwo — w1) dr, 
where K is the rotational stiffness and wo is the deviation of the winding sprocket from its 
normal angular velocity. The quantity rwo gives the angular velocity at which the film is 
running through the projector because the winding sprocket is the mechanism that pulls 
the film. Consequently, the equations governing this mechanical system are 


t 
n% xi (rwo — w1) dr + B(w2 — w1), (7.5.37) 

0 

and , 
Jy = -B(w — w1). (7.5.38) 


With the winding sprocket, the drum, and the flywheel running at their normal uniform 
angular velocities, let us assume that the winding sprocket introduces a disturbance equiv- 
alent to a unit increase in its angular velocity for 0.15 second, followed by the resumption 
of its normal velocity. It is assumed that the film in contact with the drum cannot slip. 
The initial conditions are w1 (0) = w2(0) = 0. 

Taking the Laplace transform of Equation 7.5.37 and Equation 7.5.38 and using Equa- 
tion 7.1.18, 


(ns + BH i) (hy Bs) E a(s) ee ne ar| (7.5.39) 
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and 


The solution of Equation 7.5.39 and Equation 7.5.40 for O1(s) is 


rK (s + ao)Qo(s) 
Q = 7.5.41 
(5) Ji s? + bos? + bis + bo’ ( ) 
where typical values’ are 
rK B B(J4 + J2) 
(= 90.8,ao = — = 1.47, yo 9315 = Š = 157, and bz = = 8.20. 
Jı 9997 T OETI kc gues Uds 
(7.5.42) 
The transform Qı(s) has three simple zeros in the denominator located at sı = —1.58, s2 = 


—3.32 + 11.62, and s3 = —3.32 — 11.62. 
Because the sprocket angular velocity deviation wo(t) is a pulse of unit amplitude and 
0.15 second duration, we express it as the difference of two Heaviside step functions 


wo(t) = H(t) — H(t — 0.15). (7.5.43) 
Its Laplace transform is 
1 1 
No(s) = — — -e- 9-195 (7.5.44) 
S s 


so that Equation 7.5.41 becomes 


s)= es (s + ao) e 0-155 
uu J, s(s— &1)(s — s2)(s — $3) (1 ): (7.5.45) 


The inversion of Equation 7.5.45 follows directly from the second shifting theorem and 
Heaviside's expansion theorem, or 


[ni (t) -l Ko + Ke + Koe%?! + Ket (7.5.46) 
ES [Ko zu Ke 0-915) + Koe%?'t-9-15) ais K3e52(t-0-15)] H (t = 0.16), 


where 
rK s + ao 
Ko = = 0.578, 7.5.47 
ZEE (s — s1)(s — s2)(s — $3) |, ( ) 
rK s + a9 
K= = 0.046, 7.5.48 
TUS s(s — s2)(s — 83) |s=s, ( ) 
K g 
lc SE = 0.3260169^i. (7.5.49) 
JA s(s—si)(s — 53) |=, 
and 
K dz 
eens EXAM = 0.32667 165°, (7.5.50) 
J, s(s— s1)(s — 82) | s-s; 


7 Jy = 1.84 x 104 dyne cm sec? per radian, J2 = 8.43 x 104 dyne cm sec? per radian, B = 12.4 x 104 
dyne cm sec per radian, K = 2.89 x 109 dyne cm per radian, and r = 0.578. 
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Figure 7.5.2: The deviation wi (t) of a film drum head from its uniform angular velocity when the sprocket 
angular velocity is perturbed by a unit amount for the duration of 0.15 second. 


Using Euler's identity cos(t) = (e + e^7*)/2, we can write Equation 7.5.46 as 


w(t) = 0.578 + 0.046e7 +58 + 0.652e~* 4 cos(11.6t + 165?) 
— {0.578 + 0.046e 15907013) + 9,6529 79.3260.15) 
x cos[11.6(¢ — 0.15) + 165?]H (t — 0.15). (7.5.51) 
Equation 7.5.51 is plotted in Figure 7.5.2. Note that fluctuations in w(t) are damped out 
by the particular design of this film projector. Because this mechanical device dampens 
unwanted fluctuations (or noise) in the motion-picture projector, this particular device is 
an example of a mechanical filter. 


Problems 


Use Heaviside's expansion theorem to find the inverse of the following Laplace transforms: 


1 s+3 

jo mer rare 2 F7 G46-2) 
M s—3 

3) = GEZGTUDG-3 TOT NEED 


Find the inverse of the following transforms and express them in amplitude/phase form: 


p 1 
A IE SER SEP acris 18 
2s— 5 1 
7. F = =z. 8. F ares EDUEPTOL Ee 
(s) s? + 16 (s) s(s? + 2s + 2) 
s+2 2s? — 5s +5 
(s) s(s? + 4) (s) s(s2 — 2s + 5) 


7.6 CONVOLUTION 


In this section we turn to a fundamental concept in Laplace transforms: convolution. 


We shall restrict ourselves to its use in finding the inverse of a transform when that transform 
consists of the product of two simpler transforms. In subsequent sections we will use it to 
solve ordinary differential equations. 
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We begin by formally introducing the mathematical operation of the convolution prod- 
uct 


t t 
POIO = | f agle)de — | fogt- 2) de. (7.6.1) 
0 
In most cases the operations required by Equation 7.6.1 are straightforward. 


e Example 7.6.1 


Let us find the convolution between cos(t) and sin(t). 


cos(t) * sin(t) = | sin(t — x) cos(x) dz = d [sin(t) + sin(t —2z)]dr (7.6.2) 


t t 
= d sin(t) dz + af sin(t — 2x) dx (7.6.3) 
0 0 


= }sin(t) «|, + 1cos(t — 22)|; = 1tsin(t). (7.6.4) 


e Example 7.6.2 


Similarly, the convolution between 1? and sin(t) is 


t? x sin(t) = f (t — x)” sin(x) dx (7.6.5) 
=—-(t-2)? cos(z) |o — 2 f (t — x) cos(x) dx (7.6.6) 
- £? — 2(t— z)sin(z)|; - 2 I sin(x) dx (7.6.7) 
= t? + 2cos(t) — 2 (7.6.8) 


by integration by parts. 
e Example 7.6.3 


Consider now the convolution between e* and the discontinuous function H(t — 1) — 
H(t — 2): 


e x [H(t —1) - H(t-2)] = f e*-*[H(x — 1) - H(x — 2)] dz (7.6.9) 
=é [ e *[H(x — 1) — H(z — 2)] da. (7.6.10) 
0 


In order to evaluate the integral, Equation 7.6.10, we must examine various cases. If t < 1, 
then both of the step functions equal zero and the convolution equals zero. However, when 
1 < t < 2, the first step function equals one while the second equals zero as the dummy 
variable x runs between 1 and t. Therefore, 


e x (H(t —1) - H(t-2)| = e' [ e "dz = é! — 1, (7.6.11) 
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because the portion of the integral from zero to one equals zero. Finally, when t > 2, the 
integrand is only nonzero for that portion of the integration when 1 « x « 2. Consequently, 


2 
e x[H(t-1)- H(r-2)| = ef e "dz = e! — et-?, (7.6.12) 
1 


Thus, the convolution of e* with the pulse H(t — 1) — H(t — 2) is 


0, 0<t<1, 
e* x [H(t — 1) — H(t — 2)] a et 1-1], LS 2: (7.6.13) 
ett et? 2«1 


MATLAB can also be used to find the convolution of two functions. For example, in 
the present case the commands are: 
syms x t positive 
int('exp(t-x)*(Heaviside(x-1)-Heaviside(x-2))',x,0,t) 
yield 
ans = 
-Heaviside(t-1)-*Heaviside(t-1)*exp(t-1)-*Heaviside(t-2) 
-Heaviside(t-2)*exp(t-2) 


'The reason why we introduced convolution stems from the following fundamental the- 
orem (often called Borel’s theorem®). If 


w(t) = u(t) x v(t), then W (s) = U (s)V (s). (7.6.14) 


In other words, we can invert a complicated transform by convoluting the inverses to two 
simpler functions. The proof is as follows: 


W(s) = Y » | f es da! e-*dt (T.6.15) 
z ju n idus edt dë (7.6.16) 
E i Tate | j ig vie stra dz (7.6.17) 
= is u(e)e*de| n vie-ar — U(s)V(s), (7.6.18) 


where t — r 4 x. 


e Example 7.6.4 


Let us find the inverse of the transform 


S S 1 


(x1 P41 exu £|cos(£)| C [sin()] = £[cos(t) «sin(t)) = £[ztsin(t)] (7.6.19) 


from Example 7.6.1. 


8 Borel, É., 1901: Lecons sur les séries divergentes. Gauthier-Villars, p. 104. 
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e Example 7.6.5 


Let us find the inverse of the transform 


1 1 a a 1 
= = i i ; .6.20 
(2 Fa?) a? (st Ae -) zz ^ Bin(at)]£ [sin(at)] (7 ) 
Therefore, 

om : am T sin[a(t — x)| sin(ax) dx (7.6.21) 

(s2 + a2)? ^ a d iu 

UP y a 
= m cos[|a(t — 22)] da — m cos(at) dx (7.6.22) 
1 t t 

iB. sin[a(t — 2x)] Og cos(at) x : (7.6.23) 
= zig lsin(ar) — at cos(at)]. (7.6.24) 


e Example 7.6.6 
Let us use the results from Example 7.6.3 to verify the convolution theorem. 
We begin by rewriting Equation 7.6.13 in terms of the Heaviside step functions. Using 
the method outline in Example 7.2.1, 
f(t) * g(t) = (e^! — 1) H(t - 1) + (an— e?) H(t — 2). (7.6.25) 


Employing the second shifting theorem, 


€ € 


£f«g- —1-—tX—-.4 (7.6.26) 
e75 e ?$ B 1 e^? e ?$ 

Cel» wy. 43-4 ( E E ) F820) 

= Lle'|£[H(t — 1) — H(t — 2)] (7.6.28) 


and the convolution theorem holds true. If we had not rewritten Equation 7.6.13 in terms of 
step functions, we could still have found £[f*g] from the definition of the Laplace transform. 
Problems 


Verify the following convolutions and then show that the convolution theorem is true. Use 
MATLAB to check your answer. 


1.1«1-2t 2. 1 x cos(at) = sin(at)/a 
3.1xe =e- 1 4. t*t = t?/6 


5. tx sin(t) = t — sin(t) 6. txe —- ef —t—1 
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2i t? 4 ofat 1 2 
T. t * sin(at) = — — — sin | — 8. tx H(t — 1) = 5(t— 1)^H(t — 1) 
a a 


10. t« [H(t) — H(t 3-7 RE 


H(t-2) 


Use the convolution theorem to invert the following functions: 


1 1 
11. F(s) = ~~ 12. F(s) = ———— 
(5) s?(s — 1) (s) s? (s +a)? 

13. Given? j 

ct | = nar). a » 0, 
show that 

ca/5 B 1 ea/5 - 

s—1l i ges s^! = : 
and 


ex) = [50 e] « 1 (2vat) = ZUM I(r) dr, 


where J,,(-) denotes a modified Bessel function of the first kind and order n from Section 
12.2. There we showed that Ij(7) = I(T). 


14. Using the fact that 


and given that 


aly 
=œ 
Ner 
Il 
alm 


show!” that 


Et EM m. : arcsin(1- z) ; 
E 2 m t 


where erfc(-) is the complementary error function. 


15. Prove that the convolution of two Dirac delta functions is a Dirac delta function. 


9 Watson, op. cit., p. 195. 


10 DeChant, L. J., 2004: An analytical solution for unconfined, unsteady, inviscid jets; with applications 
to penetration problem debris cloud formation. Comput. Math. Applic., 48, 201-213. 
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7.7 SOLUTION OF LINEAR DIFFERENTIAL EQUATIONS WITH CONSTANT COEFFICIENTS 


For the engineer, as it was for Oliver Heaviside, the primary use of Laplace transforms is 
the solution of ordinary, constant coefficient, linear differential equations. These equations 
are important not only because they appear in many engineering problems, but also because 
they may serve as approximations, even if locally, to ordinary differential equations with 
nonconstant coefficients or to nonlinear ordinary differential equations. 

For all of these reasons, we wish to solve the initial-value problem 


d"y d" y dy 
din tai E n + anim + any = f(E, t0, (7.7.1) 
by Laplace transforms, where aj, a2,... are constants and we know the value of y,y’,..., 


y"-) at t 2 0. The procedure is as follows. Applying the derivative rule Equation 7.1.18 
to Equation 7.7.1, we reduce the differential equation to an algebraic one involving the 
constants a1, 42,...,@n, the parameter s, the Laplace transform of f(t), and the values of 
the initial conditions. We then solve for the Laplace transform of y(t), Y (s). Finally, we 
apply one of the many techniques of inverting a Laplace transform to find y(t). 

Similar considerations hold with systems of ordinary differential equations. The Laplace 
transform of the system of ordinary differential equations results in an algebraic set of 
equations containing Y; (s), Yo(s), ..., Y, (s). By some method we solve this set of equations 
and invert each transform Y; (s), Yo(s),..., Y, (s) in turn to give yi(t), yo(t), .... ya (t). 

The following examples will illustrate the details of the process. 


e Example 7.7.1 


Let us solve the ordinary differential equation 
y" + 2y' = 8t, (7.7.2) 


subject to the initial conditions that y'(0) — y(0) — 0. Taking the Laplace transform of 
both sides of Equation 7.7.2, 
L(y”) + 2L(y’) = 8L(t), (7.7.3) 


or 


s°Y (s) — sy(0) — y'(0) + 2sY (s) — 2y (0) = 2 (7.7.4) 


s2? 


where Y (s) = £[y(t)]. Substituting the initial conditions into Equation 7.7.4 and solving 
for Y (s), 


Yi 8 ABC, D _ (s+2)At+s(s+2)B4s7(s+2)C + 9D 
| s8(s+2) s^ 52 5 sc2 s?(s + 2) l 


(7.7.5) 


Matching powers of s in the numerators of Equation 7.7.5, C+ D = 0, B+2C = 0, 
A+2B=0, and 2A = 8 or A = 4, B = —2, C = 1, and D = —1. Therefore, 


4 2 1 1 
Y(s)- bom (7.7.6) 


Finally, performing term-by-term inversion of Equation 7.7.6, the final solution is 


y(t) = 2? — t+- e”. (7.7.7) 
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We could have done the same operations using the symbolic toolbox with MATLAB. 
'The MATLAB script: 


clear 

^4 define symbolic variables 

syms s t Y 

^4 take Laplace transform of left side of differential equation 
LHS = laplace(diff(diff(sym(C y(t)?)))42*diff (syn y (£)?))) ; 

^ take Laplace transform of right side of differential equation 
RHS = laplace(8*t); 

% set Y for Laplace transform of y 

4 and introduce initial conditions 

newLHS = subs(LHS,’laplace(y(t),t,s)’,’y(0)’,’D(y) (0), Y,0,0); 
^4 solve for Y 

Y = solve(newLHS-RHS,Y) ; 

% invert Laplace transform and find y(t) 

y = ilaplace(Y,s,t) 

yields the result: 

y= 

1-exp(-2*t)-2*t+2*t^2 


which agrees with Equation 7.7.7. 


e Example 7.7.2 
Let us solve the ordinary differential equation 
y" +y = H(t) — H(t — 1) (7.7.8) 


with the initial conditions that y'(0) — y(0) — 0. Taking the Laplace transform of both 
sides of Equation 7.7.8, 


2Y (4) 390) 9 E Y) : S ug (7.7.9) 


S 


where Y (s) = £[y(t)]. Substituting the initial conditions into Equation 7.7.9 and solving 


OA AM E 8 1 8 - 
M E rao) 


Using the second shifting theorem, the final solution is 


y(t) = 1 — cos(t) — [1 — cos(t — 1) H (t — 1). (7.7.11) 


We can check our results using the MATLAB script: 


clear 

^4 define symbolic variables 

syms s t Y 

^4 take Laplace transform of left side of differential equation 
LHS = laplace(diff (diff (sym(’y(t)’)))+sym(’y(t)’)); 
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^ take Laplace transform of right side of differential equation 
RHS = laplace(’Heaviside(t) - Heaviside(t-1)’,t,s); 

% set Y for Laplace transform of y 

4 and introduce initial conditions 

newLHS = subs(LHS,’laplace(y(t),t,s)’,’y(0)’,’D(y) (0), Y,0,0); 
^4 solve for Y 

Y = solve(newLHS-RHS,Y); 

^ invert Laplace transform and find y(t) 

y = ilaplace(Y,s,t) 

which yields 


y = 
1-cos(t) -Heaviside(t-1)+Heaviside(t-1)*cos(t-1) 


e Example 7.7.3 
Let us solve the ordinary differential equation 
y” +2y'+y= f(t) (7.7.12) 


with the initial conditions that y'(0) = y(0) = 0, where f(t) is an unknown function whose 
Laplace transform exists. Taking the Laplace transform of both sides of Equation 7.7.12, 


s?Y (s) — sy(0) — y'(0) + 25Y (s) — 2y(0) + Y (s) = F(s), (7.7.13) 


where Y (s) = L[y(t)]. Substituting the initial conditions into Equation 7.7.13 and solving 


for Y (s), 
1 
Y(s) = —— ——FY(s). 7.7.14 
()- c LP) (7.7.14) 
We wrote Equation 7.7.14 in this form because the transform Y (s) equals the product of two 
transforms 1/(s-- 1)? and F(s). Therefore, by the convolution theorem we can immediately 
write 


y(t) = te™ x f(t) = f xe “f(t—«a) dz. (7.7.15) 


Without knowing f(t), this is as far as we can go. 


e Example 7.7.4: Forced harmonic oscillator 


Let us solve the simple harmonic oscillator forced by a harmonic forcing 
y" +wy = cos(wt), (7.7.16) 


subject to the initial conditions that y'(0) = y(0) = 0. Although the complete solution 
could be found by summing the complementary solution and a particular solution obtained, 
say, from the method of undetermined coefficients, we now illustrate how we can use Laplace 
transforms to solve this problem. 

Taking the Laplace transform of both sides of Example 7.7.16, substituting in the initial 
conditions, and solving for Y (s), 


(7.7.17) 
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and i , 
y(t) = — sin(wt) x cos(wt) = — sin(wt). (7.7.18) 
w 2w 


Equation 7.7.18 gives an oscillation that grows linearly with time although the forcing 
function is simply periodic. Why does this occur? Recall that our simple harmonic oscillator 
has the natural frequency w. But that is exactly the frequency at which we drive the system. 
Consequently, our choice of forcing has resulted in resonance, where energy continuously 
feeds into the oscillator. 


e Example 7.7.5 
Let us solve the system of ordinary differential equations: 
2x! + y = cos(t), (7.7.19) 


and 
y' — 2x = sin(t), (7.7.20) 


subject to the initial conditions that z(0) = 0, and y(0) = 1. Taking the Laplace transform 
of Equation 7.7.19 and Equation 7.7.20, 


2sX(s)+Y(s) = jas (7.7.21) 
and i 
—2X Y(s)= 1 + —— 7.7.22 
(s) e sY (s) 2 1 o (7.7.22) 
after introducing the initial conditions. Solving for X(s) and Y(s), 
X(s) = : (7.7.23) 
s)— CESA we 
and 3 
E E 
Y(s) = i 7.7.24 
(s) s2? +1 a (s? + 1)? ( ) 
'Taking the inverse of Equation 7.7.23 and Equation 7.7.24 term by term, 
a(t) = $[tcos(t) — sin(t)], (7.7.25) 
and 
y(t) = tsin(t) + cos(t). (7.7.26) 
The MATLAB script: 
clear 


^4 define symbolic variables 

syms s t X Y 

^4 take Laplace transform of left side of differential equations 
LHS1 = laplace(2*diff(sym(’x(t)’))+sym(’y(t)’)); 

LHS2 = laplace(diff(sym(’y(t)’))-2*sym(’x(t)’)); 

^4 take Laplace transform of right side of differential equations 
RHS1 = laplace(cos(t)); RHS2 = laplace(sin(t)); 

% set X and Y for Laplace transforms of x and y 
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% and introduce initial conditions 

newLHS1 = subs(LHS1,’laplace(x(t),t,s)’,’laplace(y(t),t,s)’,... 
’x(0)?,?y(0)?,X,Y,0,1); 

newLHS2 = subs(LHS2,’laplace(x(t),t,s)’,’laplace(y(t),t,s)’,... 
»x(0)’,’y(0)’,X,Y,0,1); 

^ solve for X and Y 

[X,Y] = solve(newLHS1-RHS1,newLHS2-RHS2,X,Y); 

% invert Laplace transform and find x(t) and y(t) 

x = ilaplace(X,s,t); y = ilaplace(Y,s,t) 

uses the symbolic toolbox to solve Equation 7.7.19 and Equation 7.7.20. MATLAB finally 

gives: 

x = 

1/2*t*cos(t)-1/2*sin(t) 

y= 

t*sin(t)+cos(t) 


e Example 7.7.6 


Let us determine the displacement of a mass m attached to a spring and excited by 
the driving force 


t 
F(t) 2 mA (: — 7) e WT. (7.7.27) 
The dynamical equation governing this system is 


t 
y! +wy=A (: = t) p. (7.7.28) 


where w? = k/m and k is the spring constant. Assuming that the system is initially at rest, 
the Laplace transform of the dynamical system is 


A A 
? + Ww? = 7.7.29 
(P APY) = Se - (7.7.29) 
or P A 
= , 7.7.3 
T8) (s?+w?)(s+1/T) T(s?+w?)(s+1/T)? ( o 
Partial fractions yield 
oe T. 1 s—1/T A 
= FIUT (s 41/T 32402) Tœ? +1/T?P 
Di. 02 2 2 
Tuae a aE | cT | pees 
s? + w? s2 +w? (s+1/T) s+1/T 
Inverting Equation 7.7.31 term by term, 
AT? P sin(wt) AT? sin(wt) 
LJ e a t) 4 (awry Ss 
y) = TP |. GET oem | reer aT 


+2 Ea 3 cos(wt)| +(+ Them (7.7.32) 
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forcing 


ft)/mA 


ytVAT? 


yt VAT? 


ytVAT? 


-1.0 1 a 1 a a 
0.0 2.0 4.0 6.0 8.0 
UT 


Figure 7.7.1: Displacement of a simple harmonic oscillator with nondimensional frequency wT as a function 
of time t/T. The top frame shows the forcing function. 


The solution to this problem consists of two parts. The exponential terms result from 
the forcing and will die away with time. This is the transient portion of the solution. The 
sinusoidal terms are those natural oscillations that are necessary so that the solution satisfies 
the initial conditions. They are the steady-state portion of the solution and endure forever. 
Figure 7.7.1 illustrates the solution when wT = 0.1, 1, and 2. Note that the displacement 
decreases in magnitude as the nondimensional frequency of the oscillator increases. 


e Example 7.7.7 


Let us solve the equation 
y" + 16y = ô(t — 7/4) (7.7.33) 
with the initial conditions that y(0) = 1, and y'(0) = 0. 
Taking the Laplace transform of Equation 7.7.33 and inserting the initial conditions, 


(s? + 16)Y (s) = s + e77, (7.7.34) 


or 
s e7 87/4 


Y(s)= | 7.7.3 
(5) = x16 316 MOSS) 


Applying the second shifting theorem, 


y(t) = cos(4t) + 1 sin[4(t — 1/4) H(t — 2/4) = cos(4t) — 4 sin(4t)H(t — 7/4). (7.7.36) 
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We can check our results using the MATLAB script: 


clear 

^4 define symbolic variables 

syms pis t Y 

^4 take Laplace transform of left side of differential equation 
LHS = laplace(diff (diff (sym(’y(t)’)))+16*sym(’y(t)’)); 

^ take Laplace transform of right side of differential equation 
RHS = laplace(’Dirac(t-pi/4)’,t,s); 

^4 set Y for Laplace transform of y 

4 and introduce initial conditions 

newLHS = subs(LHS,?laplace(y(t),t,s)?,?y(0)? ,?D(y) (0)’,Y,1,0); 
^4 solve for Y 

Y = solve(newLHS-RHS,Y) ; 

^ invert Laplace transform and find y(t) 

y = ilaplace(Y,s,t) 

which yields 


y 
cos (4*t) -1/4*Heaviside(t-1/4*pi)*sin(4*t) 


We can also verify that Equation 7.7.36 is the solution to our initial-value problem by 
computing the (generalized) derivative of Equation 7.7.36, or 


y'(t) = —4sin(4t) — cos(4t) H(t — 1/4) — $ sin(4t)ó(t — 1/4) (7.7.37) 
= —4sin(4t) — cos(4t) H (t — 1/4) — 4 sin(x)ó(t — 1/4) (7.7.38) 
= —Asin(4t) — cos(4t) H(t — 1/4), (7.7.39) 


since f(t)d(t — to) = f(to)ó(t — to). Similarly, 


y" (t) = —16 cos(4t) + 4sin(4t) H (t — 1/4) — cos(4t)d(t — 7/4) (7.7.40) 
= —16cos(4t) + 4sin(4t) H (t — 1/4) — cos(m)d(t — 1/4) (7.7.41) 
= —16cos(4t) + 4sin(4t) H (t — 1/4) + ó(t — 1/4). (7.7.42) 


Substituting Equation 7.7.36 and Equation 7.7.42 into Equation 7.7.33 completes the veri- 
fication. A quick check of y(0) and y'(0) also shows that we have the correct solution. 


e Example 7.7.8: Oscillations in electric circuits 


During the middle of the nineteenth century, Lord Kelvin! analyzed the LCR electrical 
circuit shown in Figure 7.7.2, which contains resistance R, capacitance C, and inductance L. 
For reasons that we shall shortly show, this LCR circuit has become one of the quintessential 
circuits for electrical engineers. In this example, we shall solve the problem by Laplace 
transforms. 

Because we can add the potential differences across the elements, the equation govern- 
ing the LCR circuit is 


LS + RIA ef Idr-E (7.7.43) 


11 Thomson, W., 1853: On transient electric currents. Philos. Mag., Ser. 4, 5, 393-405. 
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Figure 7.7.2: Schematic of a LCR circuit. 


where J denotes the current in the circuit. Let us solve Equation 7.7.43 when we close 
the circuit and the initial conditions are /(0) = 0 and Q(0) = —Qo. Taking the Laplace 
transform of Equation 7.7.43, 


lY Q(0) 
(zs 3p zs) T(s) = L1(0) - 7——. (7.7.44) 
Solving for I(s), 
T(s) = Qo J wo , (7.7.45) 


Cs(Ls+R+1/Cs) 5%+2as+we (s+a} +w -— a? 
where a = R/(2L), and w = 1/(LC). From the first shifting theorem, 


I(t) = ——e ™ sin(wt), (7.7.46) 


2 2 


where w? = w — o? > 0. The quantity w is the natural frequency of the circuit, which 
is lower than the free frequency wo of a circuit formed by a condenser and coil. Most 
importantly, the solution decays in amplitude with time. 

Although Kelvin’s solution was of academic interest when he originally published it, 
this radically changed with the advent of radio telegraphy!? because the LCR circuit de- 
scribed the fundamental physical properties of wireless transmitters and receivers.!? The 
inescapable conclusion from numerous analyses was that no matter how cleverly the re- 
ceiver was designed, eventually the resistance in the circuit would dampen the electrical 
oscillations and thus limit the strength of the received signal. 

This technical problem was overcome by Armstrong,!^ who invented an electrical circuit 
that used De Forests audion (the first vacuum tube) for generating electrical oscillations 
and for amplifying externally impressed oscillations by “regenerative action." The effect of 
adding the “thermionic amplifier" is seen by again considering the LRC circuit as shown in 
Figure 7.7.3 with the modification suggested by Armstrong.!° 


12 Stone, J S., 1914: The resistance of the spark and its effect on the oscillations of electrical oscillators. 
Proc. IRE, 2, 307-324. 


13 See Hogan, J. L., 1916: Physical aspects of radio telegraphy. Proc. IRE, 4, 391—420. 
14 Armstrong, E. H., 1915: Some recent developments in the audion receiver. Proc. IRE, 3, 215-247. 


15 See Ballantine, S., 1919: The operational characteristics of thermionic amplifiers. Proc. IRE, 7, 
129-161. 
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Figure 7.7.3: Schematic of an LCR circuit with the addition of a thermionic amplifier. (From Ballantine, 
S., 1919: The operational characteristics of thermionic amplifiers. Proc. IRE, 7, 155.) 


'The governing equations of this new circuit are 


merh f 14 Pe eee (7.7.47) 
! dt prm dt ^ bi 
and : 
dI dl u 
Lj— I4M—--—][ Idr= .7.48 
"n + Ro p t 2t T —0, (7.7 ) 


where the plate circuit has the current Ip, the resistance Ro, the inductance L5, and the 


electromotive force (emf) of u i Idr/C. The mutual inductance between the two circuits 
is given by M. Taking the Laplace transform of Equation 7.7.47 and Equation 7.7.48, 


L,sl(s) + RI(s) + + MsI,(s) = (7.7.49) 
and 
LosTp(s) + Rolp(s) + MsI(s) + DG) =0. (7.7.50) 


Eliminating ,(s) between Equation 7.7.49 and Equation 7.7.50 and solving for I(s), 


I(s) = (Las te Ro)Qo 
(LiL ES M?)Cs? + (RL + RoL1)Cs? + (L2 + CRRo — uM)s + Ro : 


(7.7.51) 


For high-frequency radio circuits, we can approximate the roots of the denominator of 
Equation 7.7.51 as 


Ro 
N 7.7.52 
SN- gU — uM’ ( ) 
ane R RD RE 
0 0-1 2 3 
N - dw. 7.7.53 
523 X AL, +CORRo— uM) (lil M) | ( ) 


In the limit of M and Ro vanishing, we recover our previous result for the LRC circuit. 
However, in reality, Ro is very large and our solution has three terms. The term associated 
with sı is a rapidly decaying transient while the s2 and 53 roots yield oscillatory solutions 
with a slight amount of damping. Thus, our analysis shows that in the ordinary regenerative 
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I 


2 


primary secondary 


Figure 7.7.4: Schematic of a resonance transformer circuit. 


circuit, the tube effectively introduces sufficient “negative” resistance so that the resultant 
positive resistance of the equivalent LCR circuit is relatively low, and the response of an 
applied signal voltage at the resonant frequency of the circuit is therefore relatively great. 
Later, Armstrong! extended his work on regeneration by introducing an electrical circuit— 
the superregenerative circuit—where the regeneration is made large enough so that the 
resultant resistance is negative, and self-sustained oscillations can occur.!” It was this 
circuit!? that led to the explosive development of radio in the 1920s and 1930s. 


e Example 7.7.9: Resonance transformer circuit 


One of the fundamental electrical circuits of early radio telegraphy!? is the resonance 
transformer circuit shown in Figure 7.7.4. Its development gave transmitters and receivers 
the ability to tune to each other. 

'The governing equations follow from Kirchhoff's law and are 


dl, dl; 1 i 
L M I = E(t 7.7.54 
1 di + dt + C ^ 1dr (t), ( 5 ) 
and : 
dh | dl "ue u 
Malet RES] al Indr — 0. (7.7.55) 


Let us examine the oscillations generated if initially the system has no currents or charges 
and the forcing function is E(t) = d(t). 


16 Armstrong, E. H., 1922: Some recent developments of regenerative circuits. Proc. IRE, 10, 244—260. 
17 See Frink, F. W., 1938: The basic principles of superregenerative reception. Proc. IRE, 26, 76-106. 
18 Lewis, T., 1991: Empire of the Air: The Men Who Made Radio. HarperCollins Publishers, 421 pp. 


19 Fleming, J. A., 1919: The Principles of Electric Wave Telegraphy and Telephony. Longmans, Green, 
911 pp. 
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Figure 7.7.5: The resonance curve 1/4/(r? — 1)? + 0.01 for a resonance transformer circuit with r = 
w/w. 


Taking the Laplace transform of Equation 7.7.54 and Equation 7.7.55, 


2 = I 
Lisl + Male + — =1, (7.7.56) 
sCi 
and " 
I 
MsI, + Loslo + RIS + at =0. (7.7.57) 
sb2 


Because the current in the second circuit is of greater interest, we solve for To and find that 


Tats) Ms? 
S] = 
2 [1 L2[(1 — k?)s* + 2aw3s3 + (w? + w2)s? + 2aw?s + w?w3]’ 


(7.7.58) 


where a = R/(2L2), w? = 1/(L4C1), w2 = 1/(L3C3), and k? = M?/ (LiLo), the so-called 
coefficient of coupling. 

We can obtain analytic solutions if we assume that the coupling is weak (k? < 1). 
Equation 7.7.58 becomes 


Lh Mur (7.7.59) 
^ La La(s? + w?)(s? + 2as + w2) a 
Using partial fractions and inverting term by term, we find that 
h(t) M 2owisin(wit) — , wi(w$ — wi) cos(wit) (7.7.60) 


Ys 2 2 2 2 2 2 
LiLa|(w$ — w? )? + 4a2w? (w3 — wi -A4o?wj 
4 2,2 3.2 ; 2552572 2,2 
aws — 3awtwS$ + 4o?wt _,,sin(wt) | w$(wá —wi)-T4o^w$ at 


cos(wt 
(w2 — wi)? + 4o2w? w (w3 — w?)? + 4o2w? et) 


where w? = w3 — a. 


The exponentially damped solutions will eventually disappear, leaving only the steady- 
state oscillations that vibrate with the angular frequency w1, the natural frequency of the 
primary circuit. If we rewrite this steady-state solution in amplitude/phase form, the am- 
plitude is 

M 


Li Lo\/(r? — 1)? + 402/02" 


(7.7.61) 
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where r = w3/w;. As Figure 7.7.5 shows, as r increases from zero to two, the amplitude 
rises until a very sharp peak occurs at r = 1 and then decreases just as rapidly as we 
approach r — 2. Thus, the resonance transformer circuit provides a convenient way to tune 
a transmitter or receiver to the frequency wy. 


e Example 7.7.10: Delay differential equation 

Laplace transforms provide a valuable tool in solving a general class of ordinary dif- 
ferential equations called delay differential equations. These equations arise in such diverse 
fields as chemical kinetics?? and population dynamics.?! 

To illustrate the technique,?? consider the differential equation 


x’ = —ax(t — 1) (7.7.62) 


with x(t) = 1 — at for 0 < t < 1. Clearly, z(0) = 1. 
Multiplying Equation 7.7.62 by e~** and integrating from 1 to oo, 


f a (the dt = -a f a(t — 1)e*' dt (7.7.63) 
1 1 
oo 1 oo 
n z'(t)e ** dt — | z'(t)e ** dt = -a f z(r)e-* (7*9 dr (7.7.64) 
0 0 0 


1 
sX(s)—1—4 af e * dt = —ae ? X (s) (7.7.65) 
0 
Q st —s 
sX(s)-1- ze t| = ae X(s) (7.7.66) 


since z'(t) 2 —a for 0 < t < 1. Solving for X(s), 
X(s) = (1-- ae ?/s — a/s)/|s(1 + ae ?/s)]. (7.7.67) 


To facilitate the inversion of Equation 7.7.67, we expand its denominator in terms of a 
geometric series and find that 


X(s) = Seater yeh + y (=a) te=” jan u SC E RE re 
n=0 n=0 n=0 


(7.7.68) 


The first and third sums cancel, except for the n = 0 term in the first sum. Therefore, 


xis : " Y (Caynteom TE (7.7.69) 
n=0 


20 See Roussel, M. R., 1996: The use of delay differential equations in chemical kinetics. J. Phys. Chem., 
100, 8323-8330. 


21 See the first chapter of MacDonald, N., 1989: Biological Delay Systems: Linear Stability Theory. 
Cambridge University Press, 235 pp. 


?2 See Epstein, I. R., 1990: Differential delay equations in chemical kinetics: Some simple linear model 
systems. J. Chem. Phys., 92, 1702-1712. 
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Figure 7.7.6: The solution to the delay differential equation, Equation 7.7.62, at various times t and values 
of a. 


and 
n+1 


a(t) =1+ » m DI H(t — n)(t - n)"*!. (7.7.70) 


Figure 7.7.6 illustrates Equation 7.7.70 as a function of time for various values of a. 
For 0 < a < e^1, x(t) decays monotonically from 1 to an asymptotic limit of zero. For 
e7! < a < 7/2, the solution is a damped oscillatory function. If 7/2 < a, then z(t) 
is oscillatory with an exponentially increasing envelope. When a = 7/2, x(t) oscillates 


periodically. o 


e Example 7.7.11 


Laplace transforms can sometimes be used to solve ordinary differential equations where 
the coefficients are powers of t. To illustrate this, let us solve 


y" + 2ty' — 4y = 0, y(0)=1, Jim y(t) > 0. (7.7.71) 


We begin by taking the Laplace transform of Equation 7.7.71 and find that 
d 

2 
ds 


An interesting aspect of this problem is the fact that we do not know y'(0). To circumvent 
this difficulty, let us temporarily set y'(0) = —A so that Equation 7.7.72 becomes 


dY 3 s A 1 
Y= : 7.7. 
ds ü (: =) 2s 2 ets) 


s?Y (s) — sy(0) — y'(0) [sY (s) — y(0)] — 4Y (s) = 0. (7.7.72) 


Later on, we will find A. 
Equation 7.7.73 is a first-order, linear, ordinary differential equation with s as its 
independent variable. To find Y(s), we use the standard technique of multiplying it by its 


integrating factor, here u(s) = 536-5 /4, and rewriting it as 
d 
zn [aey (s) = 1 Aste /4 — lu (7.7.74) 
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Integrating Equation 7.7.74 from s to oo, we obtain 


she y (s) = (8? + 4)e-* — A [se + m ente(sf2)] (7.7.75) 
= A Ayr 
4 ; 1 T 2/4 
Yee e /^ erfc(s/2). (7.7.76) 


We must now evaluate A. From the final-value theorem, lim; ,55 y(t) = lims—o sY (s) = 
0. Therefore, multiplying Equation 7.7.76 by s and using the expansion for the complemen- 
tary error function for small s, we have that 


14 Fees]. (7.7.77) 


In order that lim, ,9 sY (s) = 0, A = 4/ m. Therefore, 


4 1 4 4 2 
Zo ua ru M (7.7.78) 


The final step is to invert Equation 7.7.78. Applying tables and the convolution theo- 
rem, 


y(t) 2 20? +1 E = ft z)?e-* dx = (W? + 1)[1 — erf(t)] =e ^s (7.7.79) 


Problems 


Solve the following ordinary differential equations by Laplace transforms. Then use MATLAB 
to verify your solution. 


1. y -2y-21-t; y(0)=1 
2. y'—4y +3y =e; y(0) = 0,y'(0) =0 


3. y'-4Ay + 8y =e”; y(0) =0,y'(0) = 1 


T. y" +4y' + 8y=e'; (0) =0,y'(0) =2 


8. y'—4y + 5y=0;  y(0) = 2, y/(0) =4 


10. y”+3y'+2y=HA(t-1); y(0)=0,y'(0) =1 
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11.  y'—3y +2y=HĦH(t—-1); y(0) -6,v'(0) = 1 
12. y’+4y=3H(t—4); y(0) =1,y'(0) =0 


13. y” + 4y'+4y =4H(t- 2); y(0) =0,y/(0) =0 


14. y+ 3y!+2y=eTH(t—1);  y(0) =0,y'(0) = 1 
15. y'-3y + 2y =e" H(t — 2); y(0) = 0, (0) = 0 
16. y” -— 3y +2y= H(t-1) - H(t— 2); y(0) = 0,y/(0) = 0 


17. y”+y=1-H(t-T); w(0)-0,v(0) =0 


18. y'4y- ates E A y(0) = 0, y'(0) =0 


0, T<t; 
"P B t, O<t<a, — 0 wt 
19. y"-3y + 2y = { ae- 6-9) qd y(0) = 0,y'(0) = 0 
t/a, 0c t € a, 
20. y” w?y = 4 1— (t— a)/(b — a), axtzb,  y(0)=0,y'(0) =0 
0, t; 


21. y"—2y *ty-—30(t-2)5 y(0)=0,y(0)=1 


22. y” —5y'+4y=d(t—1); y(0)—0,y'(0) =0 


23. y” + 5y’ + 6y = 3d(t — 2) — 4ó6(t—5); y(0) = y’(0) = 0 


24. y” +wy' = Aó(t- T) - BH(t—7T); y(0) =y'(0) =0 
25. a’ —-2e+y=0, y'—3r—4y—-0; 2(0) =1,y(0) =0 
26. a’ —-2y'=1, vw’ +y—-—x=0; x«x(0) = y(0) =0 


27. a’ +2r—y =0, 2’ t+y+r=t; x(0)=y(0) =0 


28. a’ +3a-—y=1, 2’ +y'4+3r=0; 2(0) = 2,y(0) =0 


29. Forster, Escobal, and Lieske?? used Laplace transforms to solve the linearized equa- 
tions of motion of a vehicle in a gravitational field created by two other bodies. A simplified 
form of this problem involves solving the following system of ordinary differential equations: 


x" — 2y' = F, +z + 2y, Qa’ + y" = Fy + 2x + 3y, 


subject to the initial conditions that z(0) = y(0) = z'(0) = y'(0) = 0. Find the solution to 
this system. 


?3 Forster, K., P. R. Escobal, and H. A. Lieske, 1968: Motion of a vehicle in the transition region of the 
three-body problem. Astronaut. Acta, 14, 1-10. 
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Following Example 7.7.11, find the solution for the following ordinary differential equations: 


30. y" 4- 2ty' — 8y — 0, y(0)=1, y(0)-0 

Step 1: Show that the Laplace transform for this differential equation is 2sY’(s) + (10 — 
s2)Y (s) 2 —s. 

Step 2: Solve this first-order ordinary differential equation and show that Y (s) = 1/s + 
8/s? + 32/55 + Ae’ /4/55. 

Step 3: Invert Y (s) and show that the solution is y(t) = 1 + 4t? + 4t*/3. 


31. y" — ty’ + 2y = 0, y(0 —-1, y/(0) =0 

Step 1: Show that the Laplace transform for this differential equation is sY’(s) + (s? + 
3)Y (s) = —s. 

Step 2: Solve the first-order ordinary differential equation and show that Y (s) = (A — 
2)e- 9/2/58 + 2/88 — 1/s. 

Step 3: Invert Y (s) and show that the solution is y(t) = t? — 1. 


32. ty" - (2 — t)y' y «0 

Step 1: Show that the Laplace transform for this differential equation is s(s + 1)Y'(s) + 
2(2s + D)Y (s) = 3y(0). 

Step 2: Solve the first-order ordinary differential equation and show that Y (s) = y(0)/ 
(s+ 1) + y(0)/[2(s + 1)?] + A/[s?(s + 1)?]. 

Step 3: Invert Y (s) and show that the general solution is y(t) = C1 (t + 2)e™ + Co(t — 2). 


33. ty" — 2(a + bt)y' + b(2a + bt)y = 0, a>0 

Step 1: Show that the Laplace transform for this differential equation is (s — b)?¥’(s) + 
2(1 + a)(s — b)Y (s) = (1 + 2a)y(0). 

Step 2: Solve the first-order ordinary differential equation and show that Y (s) = y(0)/(s — 
b) + A/(s — b)?*22, 

Step 3: Invert Y (s) and show that the general solution is y(t) = Ce! + C12«*1e^t, 


Further Readings 


Churchill, R. V., 1972: Operational Mathematics. McGraw-Hill Book Co., 481 pp. A classic 
textbook on Laplace transforms. 


Doetsch, G., 1950: Handbuch der Laplace-Transformation. Band 1. Theorie der Laplace- 
Transformation. Birkhauser Verlag, 581 pp.; Doetsch, G., 1955: Handbuch der Laplace- 
Transformation. Band 2. Anwendungen der Laplace-Transformation. 1. Abteilung. Birk- 
hauser Verlag, 433 pp.; Doetsch, G., 1956: Handbuch der Laplace-Transformation. Band 3. 
Anwendungen der Laplace- Transformation. 2. Abteilung. Birkhauser Verlag, 298 pp. One 
of the standard reference books on Laplace transforms. 


LePage, W. R., 1980: Complex Variables and the Laplace Transform for Engineers. Dover, 
483 pp. Laplace transforms approached from complex variable theory and a few applica- 
tions. 
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McLachlan, N. W., 1944: Complex Variables & Operational Calculus with Technical Appli- 
cations. Cambridge Press, 355 pp. An early book on Laplace transforms from the view of 
complex variables. 


'Thomson, W. T., 1960: Laplace Transformation. Prentice-Hall, 255 pp. Presents Laplace 
transforms in the engineering applications that gave them birth. 


Watson, E. J., 1981: Laplace Transforms and Applications. Van Nostrand Reinhold, 205 
pp. A brief and very complete guide to Laplace transforms. 


Taylor & Francis 
Taylor & Francis Group 


http://taylorandfrancis.com 


SOLUTION 


Chapter 8 
The Wave Equation 


With this chapter we begin our study of linear partial differential equations. By def- 
inition, partial differential equations are those differential equations which contain partial 


derivatives. A simple example is 
Qu Ou 
i, 8.0.1 
Ot Ox ( ) 
where the solution u(x,t) depends upon distance x and time t. It is also a nonlinear partial 
differential equation because of the uu, term. 
Of all of the possible partial differential equations that one might conceive, we shall 
study a very special class: linear partial differential equations. By linear we mean that 


L(eiui + C22) = cL (ur) + cL (uz) (8.0.2) 


for any two functions u and u2, where cı and cs are arbitrary constants. For example, 
because 


a Oru Oru 

Or [cru + c2u2] = ar + al: (8.0.3) 
ai ə? 0?u, 0?us 

Bg [ciui + C2U2] = "Lyr + C2552? (8.0.4) 
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u(x,t) 


0 E. 
Figure 8.1.1: The vibrating string. 
the operator 
9'() 28C) 
L()2-——-d—- 8.0.5 
O= Fo ap one) 
is also a linear operator and the equation 
Ou u 
L—-0 8.0.6 
O° 9g ( ) 
is an example of a linear partial differential equation, as are 
Ou u u Ou 
— -a°— =), and —— c =O. 8.0.7 
8t ^ 8x? " Ox? Oy? ( ) 


Equations 8.0.6 and 8.0.7 are all examples of homogeneous linear partial differential 
equations since they can be written L(u) = 0. On the other hand, if L(u) = f(z,t), we 
have a nonhomogeneous linear partial differential equation. 

'The concepts of linearity and homogeneity also play an important role in the bound- 
ary conditions—conditions that the solution of the partial differential equation must satisfy 
along a specific boundary. Examples of linear boundary conditions are u(0,t) = f(t), 
us (Lt) = g(t), u,(0,t) = 0, and u;(L,t) = u(L,t) — h(t). Only uz(0,t) = 0 is an example 
of a homogeneous boundary condition; the other boundary conditions are examples of non- 
homogeneous boundary conditions. On the other hand, u,(0,t) = [u(0, t)]? is an example a 
nonlinear boundary condition. 

In this chapter we will study problems associated with Equation 8.0.6 where c is à 
constant. This equation, called the wave equation, serves as the prototype for a wider class 
of hyperbolic equations 


ou a) (8.0.9) 


u 
alz t) gza T ble t) 55i y c(z, t) EIE ZI. 


where b? > 4ac. It arises in the study of many important physical problems involving 
wave propagation, such as the transverse vibrations of an elastic string and the longitudinal 
vibrations or torsional oscillations of a rod. 


8.1 THE VIBRATING STRING 


The motion of a string of length L and constant density p (mass per unit length) is 
a simple example of a physical system described by the wave equation. See Figure 8.1.1. 
Assuming that the equilibrium position of the string and the interval [0, L] along the z-axis 
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coincide, the equation of motion that describes the vertical displacement u(x, t) of the string 
follows by considering a short piece whose ends are at x and «+ Ax and applying Newton's 
second law. 

If we assume that the string is perfectly flexible and offers no resistance to bending, 
Figure 8.1.1 shows the forces on an element of the string. Applying Newton's second law 
in the z-direction, the sum of forces equals 


—T (x) cos(o1) + T(x + Ax) cos(ag), (8.1.1) 
where T(x) denotes the tensile force. If we assume that a point on the string moves only 
in the vertical direction, the sum of forces in Equation 8.1.1 equals zero and the horizontal 
component of tension is constant: 


—T (x) cos(o1) + T(x + Ax) cos(az) = 0, (8.1.2) 


and 
T(x) cos(o1) = T(x + Ax) cos(a2) = T, a constant. (8.1.3) 


If gravity is the only external force, Newton’s law in the vertical direction gives 


8? 

—T (x) sin(o4) + T(z + Az) sin(og) — mg = m (8.1.4) 

where uş is the acceleration. Because 

T T 
T = d T Ag) = 8.1.5 
(x) sump ne (x + Az) costas (8.1.5) 
then 
u 

—T tan(aı) + T tan(a2) — pgAx = pAr (8.1.6) 


The quantities tan(o4) and tan(a2) equal the slope of the string at x and x + Az, respec- 
tively; that is, 


Ou(a,t Ou(a + Aa, t 
tan(oi) = e ). and tan(az) = uo (8.1.7) 
Substituting Equation 8.1.7 into Equation 8.1.6, 
Ou(a + Az,t) u(x,t) o?u 
T = pAx | = : 8.1.8 
| Óx Ox P^ OB ey ( ) 
After dividing through by Az, we have a difference quotient on the left: 
T [Ou(r- Az,t) Ou(zt)| (Ou, 
x | Ox Ox =P a Y SaR 


In the limit as Ax — 0, this difference quotient becomes a partial derivative with respect 
to z, leaving Newton's second law in the form 


2 
TX = Pg + pg, (8.1.10) 


350 Advanced Engineering Mathematics with MATLAB 


Or 9: E 
u 1 ôu g 
= TER 8.1.11 
ðr? c00 dc ( ) 
where c? = T/p. Because ug is generally much larger than g, we can neglect the last term, 
giving the equation of the vibrating string as 


2 2 
PU oe sO, (8.1.12) 
Ox? c0? 

Equation 8.1.12 is the one-dimensional wave equation. 

As a second example! we derive the threadline equation, which describes how a thread 
composed of yarn vibrates as we draw it between two eyelets spaced a distance L apart. 
We assume that the tension in the thread is constant, the vibrations are small, the thread 
is perfectly flexible, the effects of gravity and air drag are negligible, and the mass of the 
thread per unit length is constant. Unlike the vibrating string between two fixed ends, we 
draw the threadline through the eyelets at a speed V so that a segment of thread experiences 
motion in both the x and y directions as it vibrates about its equilibrium position. The 
eyelets may move in the vertical direction. 

From Newton's second law, 


d dy 
d (v2) = ps forces, (8.1.13) 
where m is the mass of the thread. But 
dy Oy | drOy 
= | ; 8.1.14 
dt | Ot | dt Ox ( ) 
Because dx /dt = V, 
dy _ Oy | Oy 
a= five, (8.1.15) 
d dy ð Oy Oy 0 Oy Oy 
= t x 8.1.1 
dt (mZ) aim (5! d E34 de EAT nu 
Because both m and V are constant, it follows that 
d dy 0?y 0?y ,9*y 
— —]= + 2mV V^—-. 8.1.17 
di (v w) a CH IS DES gd ot) 
The sum of the forces again equals 
0?y 
TA 8.1.18 
a: ( ) 
so that the threadline equation is 
0?y oy Ory 20°y 
CLAN = aS 8.1.1 
Tage t ge tam Sg EV gga? eu) 
5 9? 9? 9? 
y y 2 T|9O'y 
2V {V =0, 8.1.20 
Ot? P Oxdt ( = | Ox? ( ) 


1 See Swope, R. D., and W. F. Ames, 1963: Vibrations of a moving threadline. J. Franklin Inst., 275, 
36-55. 
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where p is the density of the thread. Although Equation 8.1.20 is not the classic wave 
equation given in Equation 8.1.12, it is an example of a hyperbolic equation. As we shall see, 
the solutions to hyperbolic equations share the same behavior, namely, wave-like motion. 


8.2 INITIAL CONDITIONS: CAUCHY PROBLEM 


Any mathematical model of a physical process must include not only the governing 
differential equation but also any conditions that are imposed on the solution. For exam- 
ple, in time-dependent problems the solution must conform to the initial condition of the 
modeled process. Finding those solutions that satisfy the initial conditions (initial data) is 
called the Cauchy problem. 

In the case of partial differential equations with second-order derivatives in time, such 
as the wave equation, we correctly pose the Cauchy boundary condition if we specify the 
value of the solution u(z,to) = f(t) and its time derivative u;(r,to) = g(t) at some initial 
time to, usually taken to be to = 0. The functions f(t) and g(t) are called the Cauchy data. 
We require two conditions involving time because the differential equation has two time 
derivatives. 

In addition to the initial conditions, we must specify boundary conditions in the spa- 
tial direction. For example, we may require that the end of the string be fixed. In the 
next chapter, we discuss boundary conditions in greater depth. However, one boundary 
condition that is uniquely associated with the wave equation on an open domain is the 
radiation condition. It requires that the waves radiate off to infinity and remain finite as 
they propagate there. 

In summary, Cauchy boundary conditions, along with the appropriate spatial boundary 
conditions, uniquely determine the solution to the wave equation; any additional information 
is extraneous. Having developed the differential equation and initial conditions necessary to 
solve the wave equation, let us now turn to the actual methods used to solve this equation. 


8.3 SEPARATION OF VARIABLES 


Separation of variables is the most popular method for solving the wave equation. 
Despite its current widespread use, its initial application to the vibrating string problem 
was controversial because of the use of a half-range Fourier sine series to represent the initial 
conditions. On one side, Daniel Bernoulli claimed (in 1775) that he could represent any 
general initial condition with this technique. To d'Alembert and Euler, however, the half- 
range Fourier sine series, with its period of 2L, could not possibly represent any arbitrary 
function. However, by 1807 Bernoulli was proven correct by the use of separation of 
variables in the heat conduction problem and it rapidly grew in acceptance.? In the following 
examples we show how to apply this method. 

Separation of variables consists of four distinct steps that convert a second-order par- 
tial differential equation into two ordinary differential equations. First, we assume that 
the solution equals the product X(x)T(t). Direct substitution into the partial differential 


? See Hobson, E. W., 1957: The Theory of Functions of a Real Variable and the Theory of Fourier’s 
Series, Vol. 2. Dover Publishers, Sections 312-314. 


3 Lützen, J., 1984: Sturm and Liouville's work on ordinary linear differential equations. The emergence 
of Sturm-Liouville theory. Arch. Hist. Exact Sci., 29, 317. 
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equation and boundary conditions yields two ordinary differential equations and the cor- 
responding boundary conditions. Step two involves solving a boundary-value problem. In 
step three we find the corresponding time dependence. Finally we construct the complete 
solution as a sum of all product solutions. Upon applying the initial conditions, we have a 
Fourier half-range expansion and must compute the Fourier coefficients. The substitution 
of these coefficients into the summation yields the complete solution. 


e Example 8.3.1 


Let us solve the wave equation for the special case when we clamp the string at x = 0 
and x — L. Mathematically, we find the solution to the wave equation 


oe = oo 0O«z«L, 0<t, (8.3.1) 
which satisfies the initial conditions 
u(z,0) = f(x), Durs —g(r, 0<a<L, (8.3.2) 
and the boundary conditions 
u(0,t) = u(L,t) 20, O«t. (8.3.3) 


For the present, we leave the Cauchy data quite arbitrary. 
We begin by assuming that the solution u(x,t) equals the product X(x)T(t). (Here T 
no longer denotes tension.) Because 


9? 
5m = XOT O, (8.3.4) 
and E 
33 = X" G)T(), (8.3.5) 
the wave equation becomes 
X =T"X, (8.3.6) 
s X" qu 


after dividing through by c? X (z)T (t). Because the left side of Equation 8.3.7 depends only 
on x and the right side depends only on t, both sides must equal a constant. We write this 
separation constant —A and separate Equation 8.3.7 into two ordinary differential equations: 


T”+2AT=0, 0<t, (8.3.8) 


and 
X" FAX =0, 0 « x « L. (8.3.9) 


We now rewrite the boundary conditions in terms of X (x) by noting that the boundary 
conditions become 
u(0,t) = X(0)T(t) = 0, (8.3.10) 
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and 
u(L,t) = X(L)T(t) 20 (8.3.11) 


for 0 « t. If we were to choose T(t) = 0, then we would have a trivial solution for u(z, t). 
Consequently, 
X(0) = X(L) = 0. (8.3.12) 


'This concludes the first step. 

In the second step we consider three possible values for A: A < 0, A = 0, and A > 0. 
Turning first to À < 0, we set \ = —m? so that square roots of A will not appear later on 
and m is real. The general solution of Equation 8.3.9 is 


X(x) = Acosh(mz) + B sinh(mz). (8.3.13) 


Because X(0) = 0, A = 0. On the other hand, X(L) = Bsinh(mL) = 0. The function 
sinh(m.L) does not equal zero since mL Æ 0 (recall m > 0). Thus, B = 0 and we have 
trivial solutions for a positive separation constant. 

If A = 0, the general solution now becomes 


X(x) 2 C 4 Drz. (8.3.14) 


The condition X(0) = 0 yields C = 0 while X(L) = 0 yields DL = 0 or D = 0. Hence, we 
have a trivial solution for the À = 0 separation constant. 
If \ = k? > 0, the general solution to Equation 8.3.9 is 


X(x) = E cos(kz) + F sin(kz). (8.3.15) 


The condition X(0) = 0 results in E = 0. On the other hand, X(L) = F'sin(kL) = 0. 
If we wish to avoid a trivial solution in this case (F Z 0), sin(kL) = 0, or kn = nm/L, 
and A, = n?z?/L?. The z-dependence equals X,(r) = F,sin(nzz/L). We added the n 
subscript to k and A to indicate that these quantities depend on n. This concludes the 
second step. 

Turning to Equation 8.3.8 for the third step, the solution to the T(t) equation is 


T5 (t) = Gn cos(k,ct) + Hn sin(k,ct), (8.3.16) 
where Gn and Hn are arbitrary constants. For each n = 1,2,3,..., a particular solution 
that satisfies the wave equation and prescribed boundary conditions is 

Un(x,t) = F, sin( 2) fen cos e3 + Hy, sin(")| ; (8.3.17) 
or 
us (x, t) = sin( Z2) |^ cos (=) + B, sin (=) ; (8.3.18) 


where An = F,G,, and B, = F,H,. This concludes the third step. 

For any choice of A, and B,, Equation 8.3.18 is a solution of the partial differential 
equation, Equation 8.3.1, also satisfying the boundary conditions, Equation 8.3.3. At this 
point we must introduce the powerful principle of linear superposition. 
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Principle of Linear Superposition 


Let u1, U2, ..., Un satisfy a linear homogeneous equation L(u;) = 0, then any arbitrary 
linear combination of u = c1u1 + c2u» +--+ + CnUn also satisfies the same linear 
homogeneous equation. 


Proof: We will outline the proof for just two solutions u and ug and it can easily be 
generalized to n solutions. If u} and uz are two homogeneous solutions of a linear homo- 
geneous equation, then L(u;) = 0 and L(uz) = 0. From the properties of linear operators, 
L(ciui + c2u2) = eL(ui1) + ea L(uo) = 0. Thus u = ciu1 + c2u» satisfies the linear homo- 


geneous equation L(u) = 0 if u; and us satisfy the same linear homogeneous equation. 


Returning to our original problem, our solution is 


u(z,t) = T sin(^77) |^ cos( 27) t B, sa( 272) (8.3.19) 


n=1 


We need no new constants because A, and B,, are still arbitrary. 

Our method of using particular solutions to build up the general solution illustrates 
the powerful principle of linear superposition, which is applicable to any linear system. 
This principle states that if u; and uz are any solutions of a linear homogeneous partial 
differential equation in any region, then u = c1u4 + c2Uz is also a solution of that equation 
in that region, where c; and cg are any constants. We can generalize this to an infinite 
sum. It is extremely important because it allows us to construct general solutions to partial 
differential equations from particular solutions to the same problem. 

Our fourth and final task remains to determine A, and Bn. At t = 0, 


u(z,0) = 53 An sin( 7) = f(z), (8.3.20) 
and x 
uz, 0) = "3 PT Bu sin(^77) = g(x). (8.3.21) 


Both of these series are Fourier half-range sine expansions over the interval (0, L). Applying 
the results from Section 5.3, 


2 L 
A= zi f(z) sin(“*) dz, (8.3.22) 
and 
NTE p x (a) si (7) a (8.3.23) 
LU BB z)sin| —— | dz, .3. 
n Eam L 
or " 
2 
B, = — g(x) sin(“**) dz. (8.3.24) 
nite Jo L 
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At this point we might ask ourselves whether the Fourier series solution to the wave equation 
always converges. For the case g(x) = 0, Carslaw* showed that if the initial position of the 
string forms a curve so that f(x) or the slope f'(x) is continuous between x = 0 and « = L, 
then the series converges uniformly. 

As an example, let us take the initial conditions 


0, 0<a<L/4, 
4h (£ — 1), L/4 < x < E. 
f(z) = (t a) (8.3.25) 
4h (3 — 2), L/2 < x < 3L/4, 
0, 3L/4< x< L, 
and 
g(x) = 0, 0 « zx « L. (8.3.26) 


In this particular example, Bn = 0 for all n because g(x) = 0. On the other hand, 


8h fil? fq 1 NTE 8h [514/3 x NTE 
Anm > si i dr (8.3.27 
AGT UM G z) sin( L ) ax L i (5 7) sin( L ) Bg ) 


E a |2sin() sin( 7) sin(“*) | (8.3.28) 
mi E C) 2sin 2) cos(“")| (8.3.29) 
M a(T)[-e()]-Mee(T)ee(T). 3.0 


because sin(A) + sin(B) = 2sin[4(A + B)| cos(3(A — B)], and 1 — cos(24) = 2sin?(A). 
Therefore, 


32h — 1 t 
u(x,t) = ae sin(—*) si^ (77) "D sin( 77) cos( 272) ; (8.3.31) 


Because sin(na/2) vanishes for n even, so does An. If Equation 8.3.31 were evaluated 
on a computer, considerable time and effort would be wasted. Consequently it is preferable 
to rewrite this equation so that we eliminate these vanishing terms. The most convenient 
method introduces the general expression n = 2m — 1 for any odd integer, where m = 
1,2,3,..., and notes that sin(2m — 1)1/2] = (—1)"**!. Therefore, Equation 8.3.31 becomes 


oe = > C sin (2m = 2 sinl (2m : De ed (2m = Dre] 
7 (8.3.32) 


Although we completely solved the problem, it is useful to rewrite Equation 8.3.32 as 


‘= 5 3X And sinf E (x — ct) + sin[  (w + ct) \ (8.3.33) 


4 Carslaw, H. S., 1902: Note on the use of Fourier’s series in the problem of the transverse vibrations of 
strings. Proc. Edinburgh Math. Soc., Ser. 1, 20, 23-28. 
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Figure 8.3.1: The vibration of a string u(x,t)/h at various positions z/L at the times ct/L = 0, 0.2, 0.4, 
0.6, 0.8, and 1. For times 1 « ct/L « 2 the pictures appear in reverse time order. 


through the application of the trigonometric identity sin(A) cos(B) = }sin(A —B) + 
3 sin(A + B). From general physics we find expressions like sin[k, (x — ct)] or sin(ka — wt) 
arising in studies of simple wave motions. The quantity sin(kx — wt) is the mathematical 
description of a propagating wave in the sense that we must move to the right at the speed 
c if we wish to keep in the same position relative to the nearest crest and trough. The 
quantities k, w, and c are the wavenumber, frequency, and phase speed or wave velocity, 
respectively. The relationship w = kc holds between the frequency and phase speed. 

It may seem paradoxical that we are talking about traveling waves in a problem dealing 
with waves confined on a string of length L. In the next section we will show that this is a 
fundamental property of solutions to the wave equation. For domains of infinite extent, the 
solution consists of two traveling waves; one runs out to positive infinity while the other 
runs out to negative infinity. Here we are dealing with standing waves because at the same 
time that a wave is propagating to the right, its mirror image is running to the left so that 
there is no resultant progressive wave motion. 

Figures 8.3.1 and 8.3.2 illustrate our solution. Figure 8.3.1 gives various cross sections. 
The single large peak at t = 0 breaks into two smaller peaks that race towards the two ends. 
At each end, they reflect and turn upside down as they propagate back towards x = L/2 at 
ct/L = 1. This large, negative peak at x = L/2 again breaks apart, with the two smaller 
peaks propagating towards the endpoints. They reflect and again become positive peaks as 
they propagate back to x = L/2 at ct/L = 2. After that time, the whole process repeats 
itself. 

MATLAB can be used to examine the solution in its totality. The script 


^4 set parameters for the calculation 

clear; M = 50; dx = 0.02; dt = 0.02; 

4 compute Fourier coefficients 

sign = 32; 

for m = 1:M 
tempi = (2*m-1)*pi; temp2 = sin(temp1/8) ; 
a(m) = sign * temp2 * temp2 / (tempi * tempi); 
sign - -sign; 

end 
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Figure 8.3.2: Two-dimensional plot of the vibration of a string u(x, t)/h at various times ct/ L and positions 
z/L. 


^4 compute grid and initialize solution 
[0:dx:1]; T = [0:dt:2]; 
zeros (length(T) ,length(X)) ; 
XX = repmat(X,[length(T) 1]); 
TT = repmat(T?,[1 length(X)]); 
^4 compute solution from Equation 8.3.32 
for m - 1:M 
tempi = (2*m-1)*pi; 
u = u + a(m) .* sin(temp1*XX) .* cos(temp1*TT) ; 


P4 
ul 


g 
[D 


end 

^4 plot space/time picture of the solution 

surf (XX,TT,u) 

xlabel(’DISTANCE’ ,’Fontsize’,20); ylabel(’TIME’,’Fontsize’ ,20) 
zlabel (’SOLUTION’ , ’Fontsize’ ,20) 


gives a three-dimensional view of Equation 8.3.32. The solution can be viewed in many 
different prospects using the interactive capacity of MATLAB. 

An important dimension to the vibrating string problem is the fact that the wavenum- 
ber kn is not a free parameter but has been restricted to the values of nr /L. This restriction 
on wavenumber is common in wave problems dealing with limited domains (for example, a 
building, ship, lake, or planet) and these oscillations are given the special name of normal 
modes or natural vibrations. 

In our problem of the vibrating string, all of the components propagate with the same 
phase speed. That is, all of the waves, regardless of wavenumber k,,, move the characteristic 
distance cAt or —cAt after the time interval At elapsed. In the next example we will see 
that this is not always true. 
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e Example 8.3.2: Dispersion 


In the preceding example, the solution to the vibrating string problem consisted of two 
simple waves, each propagating with a phase speed c to the right and left. In many problems 
where the equations of motion are a little more complicated than Equation 8.3.1, all of the 
harmonics no longer propagate with the same phase speed but at a speed that depends 
upon the wavenumber. In such systems the phase relation varies between the harmonics 
and these systems are referred to as dispersive. 

A modification of the vibrating string problem provides a simple illustration. We now 
subject each element of the string to an additional applied force that is proportional to its 
displacement: 

u — 407u 

Oe © ax 
where h > 0 is constant. For example, if we embed the string in a thin sheet of rubber, then 
in addition to the restoring force due to tension, there is a resistive force on each portion 
of the string as the rubber seeks to rebound. From its use in the quantum mechanics of 
“scalar” mesons, Equation 8.3.34 is often referred to as the Klein-Gordon equation. 

We shall again look for particular solutions of the form u(x,t) = X(x)T (t). This time, 
however, 


—hu, 0<a<L, 0<t, (8.3.34) 


XT” — 2 X"T+4hXT 20, (8.3.35) 
of n n 
T h X 
= = 8. . 6 
GT + E X À, (8.3.36) 


which leads to two ordinary differential equations 
X" E AX — 0, (8.3.37) 


and 
T" + (Ac? +h)T — 0. (8.3.38) 


If we attach the string at x = 0 and x = L, the X(x) solution is 


X,(z)— sin(“**) (8.3.39) 


with kn = nz/L, and Àn = n?z?/L?. On the other hand, the T(t) solution becomes 
T.(t) = An cos( kic ht) t B, sin( kb it) (8.3.40) 


so that the product solution is 
. (mna . 
us (mt) = sin(77) |^ cos( k2c? 4- At) + B, sin( k2c? +h jl: (8.3.41) 


Finally, the general solution becomes 


u(z,t) = Y sin( 2) An cos( kic ht) + Bn sin( kic i) (8.3.42) 
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Figure 8.3.3: The vibration of a string u(x, t)/h embedded in a thin sheet of rubber at various positions 
z/ L at the times ct/ L = 0, 0.2, 0.4, 0.6, 0.8, and 1 for hL?/c? = 10. The same parameters were used as in 
Figure 8.3.1. 


from the principle of linear superposition. Let us consider the case when B,, = 0. Then we 
can write Equation 8.3.42 as 


u(x,t) = 5 E bin(ksa + kee + ht) + sin (Ine — y k2? +h ) . (8.3.43) 


n=1 


Comparing our results with Equation 8.3.33, the distance that a particular mode kn moves 
during the time interval At depends not only upon external parameters such as h, the tension 
and density of the string, but also upon its wavenumber (or equivalently, wavelength). 
Furthermore, the frequency of a particular harmonic is larger than that when h = 0. This 
result is not surprising, because the added stiffness of the medium should increase the 
natural frequencies. 

The importance of dispersion lies in the fact that if the solution u(z,t) is a superpo- 
sition of progressive waves in the same direction, then the phase relationship between the 
different harmonics changes with time. Because most signals consist of an infinite series 
of these progressive waves, dispersion causes the signal to become garbled. We show this 
by comparing the solution, Equation 8.3.42 given in Figures 8.3.3 and 8.3.4 for the initial 
conditions, Equation 8.3.25 and Equation 8.3.26, with hL?/c? = 10, to the results given in 
Figures 8.3.1 and 8.3.2. In the case of Figure 8.3.4, the MATLAB script line 
u = u + a(m) .* sin(temp1*XX) .* cos(temp1*TT) ; 
has been replaced with 
temp2 - tempi * sqrt(1 * H/(tempi*tempi)); 

u = u + a(m) .* sin(templ*XX) .* cos(temp2*TT) ; 

where H = 10 is defined earlier in the script. Note how garbled the picture becomes at 
ct/ L = 2 in Figure 8.3.4 compared to the nondispersive solution at the same time in Figure 
8.3.2. 


e Example 8.3.3: Damped wave equation 


In the previous example a slight modification of the wave equation resulted in a wave 
solution where each Fourier harmonic propagates with its own particular phase speed. In 
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Figure 8.3.4: The two-dimensional plot of the vibration of a string u(z, t)/h embedded in a thin sheet of 
rubber at various times ct/ L and positions x/L for hL?/c? = 10. 


this example we introduce a modification of the wave equation that results not only in 
dispersive waves but also in the exponential decay of the amplitude as the wave propagates. 

So far we have neglected the reaction of the surrounding medium (air or water, for 
example) on the motion of the string. For small-amplitude motions this reaction opposes 
the motion of each element of the string and is proportional to the element's velocity. The 
equation of motion, when we account for the tension and friction in the medium but not 
its stiffness or internal friction, is 


o?u ðu u 


= L : .3.44 
ag or E age O0<a<L, 0<t (8.3.44) 


Because Equation 8.3.44 first arose in the mathematical description of the telegraph,’ it is 
generally known as the equation of telegraphy. The effect of friction is, of course, to damp 
out the free vibration. 

Let us assume a solution of the form u(x,t) = X(x)T(t) and separate the variables to 
obtain the two ordinary differential equations: 


X" +\X — 0, (8.3.45) 


and 
T" + 2hT' +rA°T =0 (8.3.46) 


with X(0) = X(L) = 0. Friction does not affect the shape of the normal modes; they are 
still 


a) (8.3.47) 


Xp(x) = sin( "77 


with kn = nr/L and Ay, = n?n? / L. 


5 The first published solution was by Kirchhoff, G., 1857: Über die Bewegung der Electrität in Drähten. 
Ann. Phys. Chem., 100, 193-217. English translation: Kirchhoff, G., 1857: On the motion of electricity 
in wires. Philos. Mag., Ser. 4, 13, 393-412. 


The Wave Equation 361 


n : ct/L-1 
0.0 
-1.0 r 
n i ct/L = 0.8 
0.0 
-1.0 r 
O ct/L = 0.6 
0.0 
-1.0 
E 10 ct/L = 0.4 
i oo 
-1.0 
O ct/L = 0.2 
0.0 
-1.0 
D ct/L = 0 
0.0 
-1.0 1 
0.0 0.5 1.0 


xL 


Figure 8.3.5: The vibration of a string u(z, t) /h with frictional dissipation at various positions z/L at the 
times ct/L = 0, 0.2, 0.4, 0.6, 0.8, and 1 for hL/c — 1. The same parameters were used as in Figure 8.3.1. 


The solution for the T(t) equation is 
T(t) = e^t |^ cos( kia t) 4 B, sin( k2 — h? ] (8.3.48) 


with the condition that kpc > h. If we violate this condition, the solutions are two ex- 
ponentially decaying functions in time. Because most physical problems usually fulfill this 
condition, we concentrate on this solution. 

From the principle of linear superposition, the general solution is 


ulz, t) = eS sin (275) [An cos( VEZE Mt) + Bn sin( VEIT Ae)], (8.3.49) 
n=1 


where mc > hL. From Equation 8.3.49 we see two important effects. First, the presence 
of friction slows all of the harmonics. Furthermore, friction dampens all of the harmonics. 
Figures 8.3.5 and 8.3.6 illustrate the solution using the initial conditions given by Equation 
8.3.25 and Equation 8.3.26 with hL/c = 1. In the case of Figure 8.3.6, the script line that 
produced Figure 8.3.2: 

u = u + a(m) .* sin(temp1*XX) .* cos(temp1*TT) ; 

has been replaced with 

temp2 = tempi * sqrt(1 - (HxH)/(tempi*tempi)); 

u = u + a(m) .* exp(-H*TT) .* sin(tempi*XX) .* cos(temp2*TT); 

where H = 1 is defined earlier in the script. Because this is a rather large coefficient of 
friction, Figures 8.3.5 and 8.3.6 exhibit rapid damping as well as dispersion. 

'This damping and dispersion of waves also occurs in solutions of the equation of teleg- 
raphy where the solutions are progressive waves. Because early telegraph lines were short, 
time delay effects were negligible. However, when engineers laid the first transoceanic cables 
in the 1850s, the time delay became seconds and differences in the velocity of propagation of 
different frequencies, as predicted by Equation 8.3.49, became noticeable to the operators. 
Table 8.3.1 gives the transmission rate for various transatlantic submarine telegraph lines. 
As it shows, increases in the transmission rates during the nineteenth century were due 
primarily to improvements in terminal technology. 
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Figure 8.3.6: The vibration of a string u(r,t)/h with frictional dissipation at various times ct/L and 
positions z/ L for hL/c = 1. 


When they instituted long-distance telephony just before the turn of the twentieth 
century, this difference in velocity between frequencies should have limited the circuits to a 
few tens of miles. However, in 1899, Prof. Michael Pupin at Columbia University showed 
that by adding inductors (“loading coils") to the line at regular intervals, the velocities at 
the different frequencies could be equalized.’ Heaviside? and the French engineer Vaschy? 
made similar suggestions in the nineteenth century. Thus, adding resistance and inductance, 
which would seem to make things worse, actually made possible long-distance telephony. 
Today you can see these loading coils as you drive along the street; they are the black 
cylinders, approximately one between each pair of telephone poles, spliced into the telephone 
cable. The loading of long submarine telegraph cables had to wait for the development of 
permalloy and mu-metal materials of high magnetic induction. 


Problems 
Solve the wave equation uj, = c?u44, 0 < x < L, 0 < t, subject to the boundary conditions 
that u(0,t) = u(L,t) = 0,0 < t, and the following initial conditions for 0 < x < L. Use 
MATLAB to illustrate your solution. 


1. u(z,0) 20, u(x,0)—1 


2. u(z,0) 21,  w(2,0) 20 


6 Rayleigh, J. W., 1884: On telephoning through a cable. Brit. Assoc. Rep., 632-633; Jordan, D. W., 
1982: The adoption of self-induction by telephony, 1886-1889. Ann. Sci., 39, 433-461. 


T There is considerable controversy concerning who is exactly the inventor. See Brittain, J. E., 1970: 
The introduction of the loading coil: George A. Campbell and Michael I. Pupin. Tech. Culture, 11, 36-57. 


5 First published 3 June 1887. Reprinted in Heaviside, O., 1970: Electrical Papers, Vol. 2. Chelsea 
Publishing, pp. 119-124. 


9 See Devaux-Charbonnel, X. G. F., 1917: La contribution des ingénieurs frangais à la téléphonie à 


grande distance par cables souterrains: Vaschy et Barbarat. Rev. Gén. Electr., 2, 288-295. 
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Table 8.3.1: Technological Innovation on Transatlantic Telegraph Cables 


Year 


1857-58 
1870 
1872 
1879 
1894 
1915-20 


1923-28 
1928-32 


1950 
1956 


Technological Innovation 


Mirror galvanometer 


Condensers 
Siphon recorder 
Duplex 


Larger diameter cable 
Brown drum repeater and Heurtley 


magnifier 


Magnetically loaded lines 
Electronic signal shaping amplifiers 


Performance 
(words/min) 


3-7 
12 

17 

24 
72-90 
100 


300-320 
480 


and time division multiplexing 


Repeaters on the continental shelf 
Repeater telephone cables 


100—300 
21600 


From Coates, V. T., and B. Finn, 1979: A Retrospective Technology Assessment: Submarine Telegraphy. 
The Transatlantic Cable of 1866. San Francisco Press, Inc., 268 pp. 


4. u(z, 0) = [3sin(zz/L) — sin(37z/L)]/4, 


5. u(z, 0) = sin(zz/L), 


u 3hz/2L, 
dope { 3h(L — z)/L, 


6. u(7,0) 20, w(z,0)— E — x)/L, 


7. u(z,0) = T 


T, 
— t, 


8. Solve the wave equation 


0< z< 2L/3, u 
eee. ue 
u(x, 0) = 0, 
0, 0<a<L/4 
ur(x,0) = «4 a, L/A < x « 3L/A 
0, 3L/4<r< L 
ax/L, 0<a<L/2 
L/2<a<L 
0 €x «Lb/2, E 
Lue duo Ud 
u u 
a E pr?’ O<T<T, 0<t, 


subject to the boundary conditions u,(0,t) = us(7,t) = 0, 0 < t, and the initial conditions 
u(x,0) = 0, u;(z,0) = 1+ cos*(z), 0 < x < v. Hint: You must include the separation 


constant of zero 


9. One of the classic applications of the wave equation has been the explanation of the 
acoustic properties of string instruments. Usually we excite a string in one of three ways: 
by plucking (as in the harp, zither, etc.), by striking with a hammer (piano), or by bowing 
(violin, violoncello, etc.). In all of these cases, the governing partial differential equation is 


u 0u 
aN EOE 
Ot? Ox?’ 


O0<a<L, 0<t, 
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with the boundary conditions u(0, t) = u(L,t) = 0,0 < t. For each of the following methods 
of exciting a string instrument, find the complete solution to the problem: 


(a) Plucked string 


For the initial conditions: 


Co UN od u(x,0 20, O<a<L, 


show that 


We note that the harmonics are absent where sin(nza/L) = 0. Thus, if we pluck 
the string at the center, all of the harmonics of even order are absent. Furthermore, the 
intensity of the successive harmonics varies as n~?. The higher harmonics (overtones) are 
therefore relatively feeble compared to the n — 1 term (the fundamental). 


(b) String excited by impact 


The effect of the impact of a hammer depends upon the manner and duration of the contact, 
and is more difficult to estimate. However, as a first estimate, let 


HM, a—e«cmrc«ac-ce, 
u(r,0 —0, O<a<L, u(x, 0) = 15 D Boss 


where e «& 1. Show that the solution in this case is 
oo 


4uL 1 t 
ut) = E D sin (7) sin( ^75) sia (272) sin (272) 


As in part (a), the nth mode is absent if the origin is at a node. The intensity of the 
overtones is now of the same order of magnitude; higher harmonics (overtones) are relatively 
more in evidence than in part (a). 


(c) Bowed violin string 


The theory of the vibration of a string when excited by bowing is poorly understood. The 
bow drags the string for a time until the string springs back. After a while the process 
repeats. It can be shown!? that the proper initial conditions are 


u(r,0)—0, w(x2,0) = 46c(L — z)/L?, 0<a<L, 


where 8 is the maximum displacement. Show that the solution is now 


88 QA 1 , /nra\ , [nret 
u(x,t) = E 5 72 sin( L )sin( L ) : 
n=1 


10 See Lamb, H., 1960: The Dynamical Theory of Sound. Dover Publishers, Section 27. 
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Although largely self-educated in mathematics, Jean Le Rond d'Alembert (1717-1783) gained equal 
fame as a mathematician and philosophe of the continental Enlightenment. By the middle of the 
eighteenth century, he stood with such leading European mathematicians and mathematical physi- 
cists as Clairaut, D. Bernoulli, and Euler. Today we best remember him for his work in fluid 
dynamics and applying partial differential equations to problems in physics. (Portrait courtesy of 
the Archives de l'Académie des sciences, Paris.) 


8.4 D'ALEMBERT'S FORMULA 


In the previous section we sought solutions to the homogeneous wave equation in the 
form of a product X (z)T(t). For the one-dimensional wave equation there is a more general 
method for constructing the solution, published by d'Alembert!! in 1747. 

Let us determine a solution to the homogeneous wave equation 


u u 
og ^ [e a2’ co«r«oo, 0<t, (8.4.1) 
which satisfies the initial conditions 
ð 0 
u(x, 0) = f(x), -a = g(x), -—oo«m«oo. (8.4.2) 


We begin by introducing two new variables €,7 defined by € = x + ct, and 7 = x — ct, 
and set u(x,t) = w(€,7). The variables € and 7 are called the characteristics of the wave 
equation. Using the chain rule, 

ð 00 OnO ð o 


Br E  Dr06 UE Om joe] 


11 D'Alembert, J., 1747: Recherches sur la courbe que forme une corde tendué mise en vibration. Hist. 
Acad. R. Sci. Belles Lett., Berlin, 214—219. 
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ð æð mA ð a 


a ooe am OE On ES) 
09/0, Ə) mala. a 
0x3 7 ax OE (s | Z) PEON (s i >) Bes) 
2 2 2 
2 g 2 (8.4.6) 


= 58 "^o. wy 


2 2 2 2 
5s -?(5 2 + 2 J (8.4.7) 


and similarly 


2 
ot? gE? OtOm an? 
so that the wave equation becomes 
G (8.4.8) 
OEOn . pes 
The general solution of Equation 8.4.8 is 
w(&,u) = F(g) + G(n). (8.4.9) 
Thus, the general solution of Equation 8.4.1 is of the form 
u(x,t) = F(x + ct) + G(x — ct), (8.4.10) 


where F and G are arbitrary functions of one variable and are assumed to be twice differen- 
tiable. Setting t = 0 in Equation 8.4.10 and using the initial condition that u(z,0) = f(x), 


F(x) + G(x) = f(x). (8.4.11) 
The partial derivative of Equation 8.4.10 with respect to t yields 


Qu(z, t) 
Ot 


= cF' (x + ct) — cG" (x — ct). (8.4.12) 


Here primes denote differentiation with respect to the argument of the function. If we set 
t = 0 in Equation 8.4.12 and apply the initial condition that u;(z,0) = g(x), 


cF' (x) — cG" (x) = g(x). (8.4.13) 
Integrating Equation 8.4.13 from 0 to any point x gives 
1 x 
F(x)—-G(x)--]| g(r)dr4C, (8.4.14) 
0 
where C is the constant of integration. Combining this result with Equation 8.4.11, 


F(x) = fe) + x: [a dr + E (8.4.15) 


and 


G(x) = go) d T g(r)dr — —. (8.4.16) 
0 
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Figure 8.4.1: D'Alembert's solution, Equation 8.4.18, to the wave equation. 


If we replace the variable x in the expression for F and G by x + ct and x — ct, respectively, 
and substitute the results into Equation 8.4.10, we finally arrive at the formula 


u(x,t) = H 


5 2» g(t) dr. (8.4.17) 


f(@+a)+f(e—ct) 1 a 


—ct 


This is known as d’Alembert’s formula for the solution of the wave equation, Equation 8.4.1, 
subject to the initial conditions, Equation 8.4.2. It gives a representation of the solution in 
terms of known initial conditions. 


e Example 8.4.1 
To illustrate d’Alembert’s formula, let us find the solution to the wave equation, Equa- 
tion 8.4.1, satisfying the initial conditions u(z,0) = H(x --1)— H(z — 1) and u(z,0) = 0, 


—oo « z « oo. By d'Alembert's formula, Equation 8.4.17, 


u(x,t) = 4 [H (x + ct +1) + H(r—ct-1) - H(z--ct 1) - H(z-ct — 1). (8.418) 


We illustrate this solution in Figure 8.4.1 generated by the MATLAB script: 


^ set mesh size for solution 
clear; dx = 0.1; dt = 0.1; 
^ compute grid 
X=[-10:dx:10]; T = [0:dt:10]; 
for j-1:length(T); t = T(j); 
for i=1:length(X); x = X(i); 
^4 compute characteristics 
characteristic 1 = x + t; characteristic 2-2» x - t; 
4 compute solution 
XX(i,j) = x; TTG,j) = t; 
u(i,j) = 0.5*(stepfun(characteristic_1,-1)+stepfun(characteristic_2,-1)... 
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Figure 8.4.2: The propagation of waves due to an initial displacement according to d’Alembert’s formula. 


-stepfun(characteristic.1, 1)-stepfun(characteristic 2, 1)); 
end; end 
surf(XX,TT,u); colormap autumn; 
xlabel(C DISTANCE?,?Fontsize?,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel(’SOLUTION’ , ’Fontsize’ ,20) 


In this figure, you can clearly see the characteristics as they emanate from the discontinuities 
at x = +1. 


e Example 8.4.2 


Let us find the solution to the wave equation, Equation 8.4.1, when u(z,0) = 0, and 
u(x, 0) = sin(2r), —oo < x < oo. By d’Alembert’s formula, the solution is 


i. pee sin(22) sin(2ct 
u(t) = 5 ji ORe E (8.4.19) 


—ct 


In addition to providing a method of solving the wave equation, d'Alembert's solution 
can also provide physical insight into the vibration of a string. Consider the case when we 
release a string with zero velocity after giving it an initial displacement of f(a). According 
to Equation 8.4.17, the displacement at a point x at any time t is 

f(x + ct) + fleet) 


u(x,t) = 7 : (8.4.20) 


Because the function f(x — ct) is the same as the function of f(x) translated to the right by 
a distance equal to ct, f (z— ct) represents a wave of form f(x) traveling to the right with the 
velocity c, a forward wave. Similarly, we can interpret the function f(x -- ct) as representing 
a wave with the shape f(x) traveling to the left with the velocity c, a backward wave. Thus, 
the solution, Equation 8.4.17, is a superposition of forward and backward waves traveling 
with the same velocity c and having the shape of the initial profile f(x) with half of the 
amplitude. Clearly the characteristics x + ct and x — ct give the propagation paths along 
which the waveform f(x) propagates. 
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e Example 8.4.3 


To illustrate our physical interpretation of d’Alembert’s solution, suppose that the 
string has an initial displacement defined by 


— a — |z], —axmpxa, 
fp { 0, otherwise. (8.4.21) 


In Figure 8.4.2(A) the forward and backward waves, indicated by the dashed line, coincide 
at t = 0. As time advances, both waves move in opposite directions. In particular, at t = 
a/(2c), they moved through a distance a/2, resulting in the displacement of the string shown 
in Figure 8.4.2(B). Eventually, at t = a/c, the forward and backward waves completely 
separate. Finally, Figures 8.4.2(D) and 8.4.3(E) show how the waves radiate off to infinity 
at the speed of c. Note that at each point the string returns to its original position of rest 
after the passage of each wave. 

Consider now the opposite situation when u(x,0) = 0, and u;(r,0) = g(x). The 
displacement is 


atct 
u(x,t) = x] g(r) dr. (8.4.22) 
2c x—ct 
If we introduce the function i 
lz) = xf g(r) dr, (8.4.23) 
2c 0 


then we can write Equation 8.4.22 as 
u(z,t) = p(x + ct) — (x — ct), (8.4.24) 


which again shows that the solution is a superposition of a forward wave —y(a — ct) and 
a backward wave y(x + ct) traveling with the same velocity c. The function y, which we 
compute from Equation 8.4.23 and the initial velocity g(x), determines the exact form of 
these waves. 


e Example 8.4.4: Vibration of a moving threadline 


'The characterization and analysis of the oscillations of a string or yarn have an impor- 
tant application in the textile industry because they describe the way that yarn winds on a 
bobbin.!? As we showed in Section 8.1, the governing equation, the “threadline equation,” 
is 

u Ot x go 
+ 
Ot? Oxot Ox? 
where a = 2V, 8 = V? — gT/p, V is the windup velocity, g is the gravitational attraction, 
T is the tension in the yarn, and p is the density of the yarn. We now introduce the 
characteristics £ = x + Ait, and 7 = x + Ast, where A; and A2 are yet undetermined. Upon 
substituting € and 7 into Equation 8.4.25, 


=0, (8.4.25) 


(A? + 2VA1 + V? — gT/p)uee + (A2 + 2V 2 + V? — gT /p)Unn 
+ [2V? — 2gT'/p + 2V (4 + A2) + 2A1A2]Uen = 0. (8.4.26) 


12 See Swope, R. D., and W. F. Ames, 1963: Vibrations of a moving threadline. J. Franklin Inst., 275, 
36-55. 
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Figure 8.4.3: Displacement of an infinite, moving threadline when c = 10, and V = 1. 
If we choose A; and As to be roots of the equation 
X 2VA +V’ — gT/p — 0, (8.4.27) 


Equation 8.4.26 reduces to the simple form 


ugn = 0, (8.4.28) 
which has the general solution 
u(x,t) = F(£) + G(n) = F(x + Ait) + G(x + Ast). (8.4.29) 
Solving Equation 8.4.27 yields 
Ay =c-V, and Ag = —c— V, (8.4.30) 


where c = ,/gT/p. If the initial conditions are 
u(z,0) = f(x), and ur(x,0) = g(x), (8.4.31) 


then 
atAit 


= x XE A EAE jJ 


g(T) ar| ; (8.4.32) 
z4-Ast 


Because A; does not generally equal Ao, the two waves that constitute the motion of 
the string move with different speeds and have different shapes and forms. For example, if 


f(x) = a D and g(z)- 0, (8.4.33) 
1 c—V c+V 
toa xl 14+ |[e—(e+V)t? 1 [z — (c - Vt? \ eee.) 


Figures 8.4.3 and 8.4.4 illustrate this solution for several different parameters. 
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Figure 8.4.4: Displacement of an infinite, moving threadline when c = 11, and V = 10. 
Problems 


Use d'Alembert's formula to solve the wave equation, Equation 8.4.1, for the following initial 
conditions defined for |x| < oo. Then illustrate your solution using MATLAB. 


1. u(z,0) = 2sin(z) cos(x) u(x, 0) = cos(x) 

2. u(x,0) = vsin(z) u(x, 0) = cos(2z) 

3.  u(z,0) — 1/(z? +1) u(x, 0) = e? 

4. u(a,0)=e* u(x, 0) = 1/(a? + 1) 

5.  u(x,0) = cos(ra/2) u(x, 0) = sinh (ax) 

6.  u(z,0) = sin(3z) u(x, 0) = sin(2x) — sin(x) 


7. Assuming that the functions F and G are differentiable, show by direct substitution that 


u(a,t) = EF(x + ct) - EG(a — ct) — ikêt? + kx, 


and 4 
keat 
v(z,t) = cF («+ ct) + cG(a — ct) — abe: 
AE 
are the d'Alembert solutions to the hyperbolic system 
o o o o 
Re = 2 + ka, —oo«mrc«oo, 0<t, 


ðt Ox’ Oc ^8 
where c? = E/p and E, k, and p are constants. 


8. D’Alembert’s solution can also be used in problems over the limited domain 0 < x < L. 
To illustrate this, let us solve the wave equation, Equation 8.4.1, with the initial conditions 
u(x,0) = 0, ue(v,0) = Vmaz(1 — z/L), 0 < x < L, and the boundary conditions u(0,t) = 
u(L,t) — 0, 0 « t. 


Step 1: Show that the solution to this problem is 


u(x,t) = z[Vo(z + ct) — Vo(a — ct)], 
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where T. i 
Volx) = f ugod ex (1-2), o<x<t, 
€ Jo C 2L 
along with the periodicity conditions Vo(x) = Vo(—x), and Vo(L + x) = Vo(L — x) to take 
care of those cases when the argument of Vo(-) is outside of (0, L). Hint: Substitute the 
solution into the boundary conditions. 


Step 2: Show that at any point x within the interval (0, L), the solution repeats with a 
period of 2L/c if ct > 2L. Therefore, if we know the behavior of the solution for the time 
interval 0 « ct « 2L, we know the behavior for any other time. 


Step 3: Show that the solution at any point x within the interval (0, L) and time t + L/c, 
where 0 « ct « L, is the mirror image (about u — 0) of the solution at the point L — z and 
time t, where 0 < ct « L. 


Step 4: Show that the maximum value of u(x,t) occurs at x = ct, where 0 < x < L and 
when 0 < ct < L. At that point, 


c 
where Umax equals the largest magnitude of u(x,t) for any time t. Plot Umag as a function 
x and show that it is a parabola. Hint: Find the maximum value of u(x,t) when 0 < x < ct 
and ct <x < L with0 « x-ct« Lor L € z 4 ct « 2L. 


8.5 NUMERICAL SOLUTION OF THE WAVE EQUATION 


In addition to separation of variables, linear wave equations can also be solved using the 
method of characteristics and transform methods. However, when these analytic techniques 
fail or we have a nonlinear wave equation, we must resort to numerical techniques. 

In contrast to the continuous solutions, finite difference methods, a type of numerical 
solution technique, give discrete numerical values at a specific location (£m, tn), called a 
grid point. These numerical values represent a numerical approximation of the continuous 
solution over the region (£m — Az/2, £m + Axv/2) and (tn — At/2, tn + At/2), where Ax 
and At are the distance and time intervals between grid points, respectively. Clearly, in the 
limit of Az, At — 0, we recover the continuous solution. However, practical considerations 
such as computer memory or execution time often require that Az and At, although small, 
are not negligibly small. 

The first task in the numerical solution of a partial differential equation is the re- 
placement of its continuous derivatives with finite differences. The most popular approach 
employs Taylor expansions. If we focus on the z-derivative, then the value of the solution 
at u[(m + 1)Az, nAt]| in terms of the solution at (mAz, nAt) is 


222 
u[(m + 1)Az,nAt] = u(am,tn) + Az du(tm; tn) + (a) OUa ta) 


1! Ox 2! Ox? 
l (Ax)? 0*u(z, t4) (Az)* 04u(am, tn) l 
"3 oot o4 — On Ro 
t 
= u(tm,; tn) + Ag DU Ems fn) + O[((Az)?], (8.5.2) 


Ox 


where O[(Az)?] gives a measure of the magnitude of neglected terms.? 


13 The symbol O is a mathematical notation indicating relative magnitude of terms, namely that f(e) = 
O(e") provided lime.,o|f(c)/e"^| < oo. For example, as € — 0, sin(e) = O(c), sin(c?) = O(e?), and 
cos(e) = O(1). 
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From Equation 8.5.2, one possible approximation for u, is 


OU Ta). - Vor 


Ox v Ax 


+ O(Ax), (8.5.3) 


where we use the standard notation that už, = u(£m,tn). This is an example of a one- 
sided finite difference approximation of the partial derivative u,. The error in using this 
approximation grows as Ax. 

Another possible approximation for the derivative arises from using u(mAz,nAt) and 
u|(m — 1)Az,nAt]. From the Taylor expansion: 


Az Ou(za t4) , (Av)? ulm, tn) 


T 


ul(m — 1)Az,nAt] = u(am, tn) 


1! Ox 2! Ox? 
(Az)? ufEm,tn) (Av)* 0*ultm, ta) 
a ada a ud Ro ORE) 
we can also obtain the one-sided difference formula 
(Bons tn) Um x Un-1 
= } Ax). 8.5. 
Da A O(Az) (8.5.5) 
A third possibility arises from subtracting Equation 8.5.4 from Equation 8.5.1: 
Ou(2m,tn 
wags ctia = De Mm Pa) V gs) (8.5.6) 
or 5 n i 
uz, tn) - Um+1 — Um -1 i O[(Aa)?]. (8.5.7) 


Ox 2Acx 


'Thus, the choice of the finite differencing scheme can produce profound differences in the 
accuracy of the results. In the present case, centered finite differences can yield results that 
are markedly better than using one-sided differences. 

To solve the wave equation, we need to approximate uyg. If we add Equation 8.5.1 and 
Equation 8.5.4, 


O^ u(tm,tn) 


Od (Ax)? + O[(Az)*], (8.5.8) 


n n n 
Um+1 F Um-—1 = 2Um E 


or 
uw ta) caa — 2Um t Um- 2 
mu (ADS + O[(Aa)?]. (8.5.9) 


Similar considerations hold for the time derivative. Thus, by neglecting errors of O[(Az)?] 
and O((At)?], we may approximate the wave equation by 


un uum! guys uh ua 
(ABD Lg (Az (8.5.10) 


Because the wave equation represents evolutionary change of some quantity, Equation 8.5.10 
is generally used as a predictive equation where we forecast u?*! by 


2 
TL TL TL— cAt TL TL TL 
uh = dum — url (=) (ur 4 —2ur + uma). (8.5.11) 
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Figure 8.5.1: Schematic of the numerical solution of the wave equation with fixed endpoints. 


Figure 8.5.1 illustrates this numerical scheme. 

The greatest challenge in using Equation 8.5.11 occurs with the very first predic- 
tion. When n = 0, clearly u9,,,, u9,, and u9, , are specified from the initial condition 
u(mAz,0) = f(a@m). But what about u,,!? Recall that we still have u;(z,0) = g(x). If we 
use the backward difference formula, Equation 8.5.5, 


Up, ze Um 
ACT g(@m). (8.5.12) 
Solving for u;,, 
up| = ul, — Atg(tm). (8.5.13) 


One disadvantage of using the backward finite-difference formula is the larger error 
associated with this term compared to those associated with the finite-differenced form of 
the wave equation. In the case of the barotropic vorticity equation, a partial differential 
equation with wave-like solutions, this inconsistency eventually leads to a separation of 
solution between adjacent time levels.!^ This difficulty is avoided by stopping after a certain 
number of time steps, averaging the solution, and starting again. 

A better solution for computing that first time step employs the centered difference 
form 


DAE — 9%) (8.5.14) 
along with the wave equation 
Um — 2up + tim! atm Zum + Um- 
(At)? =e (Ax)? ’ (8.5.15) 
so that 
2 2 
m cAt f (zm) F f (21) i cAt 
m= (=) 2 F1 Ax f (za) + Atg(am). (8.5.16) 


14 Gates, W. L., 1959: On the truncation error, stability, and convergence of difference solutions of the 
barotropic vorticity equation. J. Meteorol., 16, 556-568. See Section 4. 
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Although it appears that we are ready to start calculating, we need to check whether 
our numerical scheme possesses three properties: convergence, stability, and consistency. 
By consistency we mean that the difference equations approach the differential equation as 
Ax, At — 0. To prove consistency, we first write u?,,, u^, 4, u^ 1, and u?! in terms of 
u(x,t) and its derivatives evaluated at (£m,tn). From Taylor expansions, 


9u |^ u|” u|” 
Unt = Um Ary + (Ar)? a5 + #(Az)? EN i (8.5.17) 
T n Qu |" u|” u|” 
Um =u Ary + (Ar)? a5 — e (A2) a Í (8.5.18) 
" = ðu|” o?u ou 
urtl—um + At Fha 3 (At)? ag| 7 (At)? 3B es (8.5.19) 
and a m a2 m a3 m 
n-1 n u 1 2€ 1 see 
Up =U At öt |, 3 (At) OF |. 5 (At) a eae (8.5.20) 
Substituting Equations 8.5.17 through 8.5.20 into Equation 8.5.10, we obtain 
Er Er cu E RE eae 
(At)? (Ax)? 
u Puj” ^u |" O*u|" 
7 (5 B = Pag aan ae S per 


The first term on the right side of Equation 8.5.21 vanishes because u(x, t) satisfies the wave 
equation. As Az — 0, At — 0, the remaining terms on the right side of Equation 8.5.21 
tend to zero and Equation 8.5.10 is a consistent finite difference approximation of the wave 
equation. 

Stability is another question. Under certain conditions the small errors inherent in 
fixed precision arithmetic (round off) can grow for certain choices of Ax and At. During 
the 1920s the mathematicians Courant, Friedrichs, and Lewy!? found that if cAt/Ax > 1, 
then our scheme is unstable. This CFL criterion has its origin in the fact that if cAt » Az, 
then we are asking signals in the numerical scheme to travel faster than their real-world 
counterparts and this unrealistic expectation leads to instability! 

One method of determining stability, commonly called the von Neumann method,!6 
involves examining solutions to Equation 8.5.11 that have the form 


n.o PULL 


Um 


; (8.5.22) 
where 0 is an arbitrary real number and A is a yet undetermined complex number. Our 
choice of Equation 8.5.22 is motivated by the fact that the initial condition u®, can be 
represented by a Fourier series where a typical term behaves as e/""?. 


15 Courant, R., K. O. Friedrichs, and H. Lewy, 1928: Über die partiellen Differenzengleichungen der 
mathematischen Physik. Math. Annalen, 100, 32-74. Translated into English in IBM J. Res. Dev., 11, 
215-234. 

16 After its inventor, J. von Neumann. See O’Brien, G. G., M. A. Hyman, and S. Kaplan, 1950: A study 
of the numerical solution of partial differential equations. J. Math. Phys. (Cambridge, MA), 29, 223-251. 
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If we substitute Equation 8.5.22 into Equation 8.5.10 and divide out the common factor 
eim8 61^. we have that | 
ei^ 9: e ?^ nee Dicks e i9 
c 


CO (Ax) C 


sw (3) = (S sw (2) (8.5.24) 


The behavior of u7, is determined by the values of À given by Equation 8.5.24. If cAt/Aa < 
1, then A is real and u?, is bounded for all 0 as n — oo. If cAt/Azx > 1, then it is possible 
to find a value of 0 such that the right side of Equation 8.5.24 exceeds unity and the 
corresponding values of A occur as complex conjugate pairs. The A with the negative 
imaginary part produces a solution with exponential growth because n = t,/At — oo as 
At — 0 for a fixed t, and cAt/Ax. Thus, the value of u?, becomes infinitely large, even 
though the initial data may be arbitrarily small. 


(8.5.23) 


or 


e Example 8.5.1 
Let us examine the stability question using tools from linear algebra (see Section 3.5). 


Consider the explicit scheme for the numerical integration of the wave equation, Equa- 
tion 8.5.11. We can rewrite that single equation as the coupled difference equations: 


es = 2(1- rjuh, 3 r? (uny Funa) = Un (8.5.25) 
and 
unt! =u", (8.5.26) 


where r = cAt/Az. Let uf, = eiP^*u^.. and u™_, = e-*^*u^ , where B is real. Then 
Equation 8.5.25 and Equation 8.5.26 become 


A 
unl — 9 | — 2r? sin? (=)| Um — Um, (8.5.27) 
and 
n = Um: (8.5.28) 


or in the matrix form 


2.:42[ BAx 
uj ^e [rw A ( 2 )| i (8.5.29) 


n 
where up, = & J The eigenvalues À of this amplification matriz are given by 
Tri 


A -2 m 1:3] A+1=0, (8.5.30) 


A12 = 1 — 2r? sin? (=) + 2r x (225) j- sin? c3 — ]. (8.5.31) 


or 
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Figure 8.5.2: The growth of error ||en|| as a function of ct for various resolutions. For the top line, 
Ax = 0.1; for the middle line, Ax = 0.01; and for the bottom line, Ax = 0.001. 


Because each successive time step consists of multiplying the solution from the previous 
time step by the amplification matrix, the solution is stable only if u}, remains bounded. 
This occurs only if all of the eigenvalues have a magnitude less than or equal to one, because 


uy, = p* cj A" xj, = 5 CK A Xk; (8.5.32) 
k k 


where A denotes the amplification matrix and x; denotes the eigenvectors corresponding to 
the eigenvalues Ag. Equation 8.5.32 follows from our ability to express any initial condition 
in terms of an eigenvector expansion 


uj = ox. (8.5.33) 
k 
In our particular example, two cases arise. If r? sin?(8Aa/2) < 1, 


Àn2—1- 2r? sin? (=) t2ri sin( 3") i) — r? sin? (=) (8.5.34) 


and [Ai 3| = 1. On the other hand, if r? sin?(@Aa/2) > 1, |A1,2| > 1. Thus, we have stability 
only if cAt/Az < 1. 


Finally, we must check for convergence. A numerical scheme is convergent if the numer- 
ical solution approaches the continuous solution as Ax, At > 0. The general procedure for 
proving convergence involves the evolution of the error term e% , which gives the difference 
between the true solution u(£m,tn) and the finite difference solution u?,. From Equation 
8.5.21, 


e? — er + O[(At)*] + O[(Az)?(At)"]. 


m m 


(8.5.35) 
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Let us apply Equation 8.5.25 to work backwards from the point (£m, tn) by changing n to 
n — 1. The nonvanishing terms in e7, reduce to a sum of n+ 1 values on the line n = 1 plus 
i(n + 1)n terms of the form A(Az)*. If we define the max norm ||e,|| = max; |e? |, then 


lles]] € nB(Az)? + 3(n + DnA(Ax)^. (8.5.36) 
Because nAz < ct,, Equation 8.5.26 simplifies to 
lles]] € ctnB(Aa)? + 1202 A(Ax)?. (8.5.37) 


Thus, the error tends to zero as Az — 0, verifying convergence. We illustrate Equation 
8.5.37 by using the finite difference equation, Equation 8.5.11, to compute ||en|| during a 
numerical experiment that used cAt/Az = 0.5, f(x) = sin(mx), and g(x) = 0; |len|| is 
plotted in Figure 8.5.2. Note how each increase of resolution by 10 results in a drop in the 
error by 100. 

In the following examples we apply our scheme to solve a few simple initial and bound- 
ary conditions: 


e Example 8.5.2 


For our first example, we resolve Equation 8.3.1 through Equation 8.3.3 and Equation 
8.3.25 and Equation 8.3.26 numerically using MATLAB. The MATLAB code is: 


clear 
coeff = 0.5; coeffsq = coeff * coeff % coeff = cAt/Ax 
dx = 0.04; dt = coeff * dx; N = 100; x = O:dx:1; 
M = 1/dx + 1; 4 M = number of spatial grid points 
^ introduce the initial conditions via F and G 
F = zeros(M,1); G = zeros(M,1); 
for m= 1:M 
if x(m) >= 0.25 & x(m) <= 0.5 
F(m) = 4 * x(m) - 1; end 
if x(m) >= 0.5 & x(m) <= 0.75 
F(m) = 3 - 4 * x(m); end; end 
^ at t = 0, the solution is: 
tplot(1) = 0; u = zeros(M,N+1); u(1:M,1) = F(1:M); 
% at t = At, the solution is given by Equation 8.5.16 
tplot(2) = dt; 
for m = 2:M-1 
u(m,2) = 0.5*coeffsq*(F(mt+1)+F(m-1)) + (1-coeffsq) *F (m)+dt*G(m) ; 
end 
^ in general, the solution is given by Equation 8.5.11 
for n = 2:N 
tplot(nt+1) = dt * n; 
for m = 2:M-1 
u(m,n+1) = 2*u(m,n)-u(m,n-1) + coeffsq*(u(m+1 ,n)-2*u(m,n)t+u(m-1,n)); 
end; end 
X = x’ * ones(1,length(tplot)); T = ones(M,1) * tplot; 
surf (X,T,u) 
xlabel(’DISTANCE’ ,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel(’SOLUTION’ , ’Fontsize’ ,20) 
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Figure 8.5.3: The numerical solution u(z,t)/h of the wave equation with cAt/Ax = z using Equation 


8.5.11 at various positions x’ = x/L and times t' = ct/L. The exact solution is plotted in Figure 8.3.2. 


Overall, the numerical solution shown in Figure 8.5.3 approximates the exact or analytic 
solution well. However, we note small-scale noise in the numerical solution at later times. 
Why does this occur? Recall that the exact solution could be written as an infinite sum 
of sines in the x dimension. Each successive harmonic adds a contribution from waves of 
shorter and shorter wavelength. In the case of the numerical solution, the longer-wavelength 
harmonics are well represented by the numerical scheme because there are many grid points 
available to resolve a given wavelength. As the wavelengths become shorter, the higher 
harmonics are poorly resolved by the numerical scheme, move at incorrect phase speeds, 
and their misplacement (dispersion) creates the small-scale noise that you observe rather 
than giving the sharp angular features of the exact solution. The only method for avoiding 
this problem is to devise schemes that minimize dispersion. 


e Example 8.5.3 


Let us redo Example 8.5.2 except that we introduce the boundary condition that 
uz(L,t) = 0. This corresponds to a string where we fix the left end and allow the right 
end to freely move up and down. This requires a new difference condition along the right 
boundary. If we employ centered differencing, 


Up — pa 
Urs UL o 8.5.38 
2^r í l 
and 
At\? 
drop e (SE) Gta cing. dud 


Eliminating u7 ,, between Equation 8.5.38 and Equation 8.5.39, 


At\* 
ur = 2u — ut! 4 (=) (2ut.., — 2u2). (8.5.40) 
T 
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Figure 8.5.4: The numerical solution u(x, t)/h of the wave equation when the right end moves freely with 
cAt/ Ax = i using Equation 8.5.11 and Equation 8.5.40 at various positions x’ = z/L and times t’ = ct/L. 


For the special case of n — 1, Equation 8.5.40 becomes 


uz = f(r) + (=) [f(wz—1) — f(zz)] + Atf (az). (8.5.41) 


The MATLAB code used to numerically solve the wave equation with a Neumann bound- 
ary condition is very similar to the one used in the previous example that we must add the 
line 
u(M,2) = coeffsq * F(M-1) + (1-coeffsq) * F(M) + dt*G(M); 
after 
for m = 2:M-1 

u(m,2) = O.5*coeffsq*(F(m*i1)4*F(m-1)) + (1-coeffsq)*F (m)+dt*G(m) ; 
end 
and 
u(M,n+1) = 2*u(M,n)-u(M,n-1) + 2*coeffsq*(u(M-1,n)-u(M,n)); 
after 
for m = 2:M-1 
u(m,n+1) = 2*u(m,n)-u(m,n-1) + coeffsq*(u(mt+1,n)-2*u(m,n)+u(m-1,n)); 
end 


Figure 8.5.4 shows the results. The numerical solution agrees well with the exact solution 


32h = 1 : E x [en zm 


x aui 2n — Un ip e UE cag unc DRE (8.5.42) 
{aE - a a n] amni 
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Figure 8.5.5: The numerical solution u(x,t) of the first-order hyperbolic partial differential equation 
ut + ug = 0 using the Lax-Wendroff formula as observed at t = 0,1,2,...,20. The initial conditions are 
given by Equation 8.3.25 with h = 1, At/Az = 2, and Az = 0.02. 


The results are also consistent with those presented in Example 8.5.1, especially with regard 
to small-scale noise due to dispersion. 


Project: Numerical Solution of First-Order Hyperbolic Equations 


The equation u;4-u, = 0 is the simplest possible hyperbolic partial differential equation. 
Indeed, the classic wave equation consists of a system of these equations: ut + cv; = 0, and 
Ut + CU, = 0. In this project you will examine several numerical schemes for solving such a 
partial differential equation using MATLAB. 


Step 1: One of the simplest numerical schemes is the forward-in-time, centered-in-space of 


n+1 n n iub 
Um — Um + Um+1 Um—1 =0 


At 2AT 


Use von Neumann's stability analysis to show that this scheme is always unstable. 


Step 2: The most widely used method for numerically integrating first-order hyperbolic 
equations is the Laz- Wendroff method:!* 


At 
unl = Um- en (umy = uUm-—1) T (Ar)? (un ga — 2um + umi) . 


This method introduces errors of O[((At)?] and O[(Azx)?]. Show that this scheme is stable 
if it satisfies the CFL criteria of At/Ax < 1. 

Using the initial condition given by Equation 8.3.25, write a MATLAB code that uses 
this scheme to numerically integrate utg + uz = 0. Plot the results for various At/Ax over 


17 Lax, P. D., and B. Wendroff, 1960: Systems of conservative laws. Comm. Pure Appl. Math., 13, 
217-237. 
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Figure 8.5.6: Same as Figure 8.5.5 except that the centered-in-time, centered-in-space scheme was used. 


the interval 0 € x < 1 given the periodic boundary conditions of u(0,t) = u(1,t) for the 
temporal interval 0 < t < 20. See Figure 8.5.5. Discuss the strengths and weaknesses of 
the scheme with respect to dissipation or damping of the numerical solution and preserving 
the phase of the solution. Most numerical methods books discuss this.18 


Step 3: Another simple scheme is the centered-in-time, centered-in-space of 


n+1 — n ian 
Um Um j Um+1 — Um-1 =0 


2At i 2AT 


This method introduces errors of O[(At)?] and O((Az)?]. 
Repeat the analysis from Step 1 for this scheme. One of the difficulties is taking the 
first time step. Use the scheme in Step 1 to take this first time step. See Figure 8.5.6. 


Project: Implicit Schemes for Solving the Wave Equation 


Although the simple explicit time differencing scheme of Equation 8.5.10 is very easy to 
program, the restriction on the size of the time step, cAt/Az < 1, can be computationally 
expense when Az is small. In this project we will explore several implicit schemes for 
the numerical solution of the wave equation. Implicit schemes are useful because they are 
unconditionally stable for any At/Az. 

'The wave equation problem that we will solve is: 


Ə? 9? 
am = ae 0<a<1, 0<t, (8.5.43) 
which satisfies the initial conditions 
_ x/a, 0cr«a 
a { (1 — x)/(1— a), a<a<l, bee) 


18 For example, Lapidus, L., and G. F. Pinder, 1982: Numerical Solution of Partial Differential Equations 
in Science and Engineering. John Wiley & Sons, 677 pp. 
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Crank-Nicolson scheme 021/2 


u(1/2, t) 


Figure 8.5.7: The numerical solution of the wave equation problem given by Equations 8.5.43 through 
8.5.46 using various numerical schemes. The parameters are a = 0.35, pp = At/Az, and u = At/ Az. 


and 5 " 
mU LE eget, (8.5.45) 
ot 
and the boundary conditions 
u(0,t) = u(1,t) = 0, 0<t, (8.5.46) 


where 0 « a « 1. A knowledge of matrix algebra is required (see Sections 3.1 and 3.4). 
We begin by writing the finite differenced wave equation as 


up — 2u tu t (1— 6) und -2u curi nn — 2upt + apt} (8.5.47) 
(At)? i (Ax)? | (Aa)? l 
or 
-opu + (1+ 200p ut — Ou ug (8.5.48) 


-2w --(1-0487u7, - [1620 - 07]? + 0 — Our, 
where 0 € n, 0€ 0 € 1, and u = At/Aa. 

Care must be taken for the first time step when n — 0 because 8.5.48 requires u; *, an 
unknown. From the initial condition u;(z,0) = 0, however, we know that u; ! = ui (for all 
i). Consequently, 

-p ul + (2 202)u] — pul, = 2u. (8.5.49) 


For n » 1 we use Equation 8.5.48 because everything on the right side is known. Both 
Equations 8.5.48 and 8.5.49 must be solved as a system of linear equations. 
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Step 1: Using separation of variables, show that the solution to Equations 8.5.43 through 
8.5.46 is 


2 oo . 
u(x,t) = ae 2, snm sin(nzx) cos(nrt). 
Step 2: Using the simple explicit time differencing scheme of Equation 8.5.10, numerically 
solve our problem for various values of p. 


Step 3: Write a MATLAB program to solve Equation 8.5.48 for a given value of 0 and p. 
'This will require solving a tridiagonal matrix. 


Step 4: When we set 0 — 1/2 in Equation 8.5.48, we are using the Crank-Nicolson method 
to solve the wave equation. Find solutions for various values of u and compare your answer 
to the exact solution. 


Step 5: When we set 0 — 1 in Equation 8.5.48, we are solving this equation by an implicit 
scheme. Repeat Step 4 and compare your solution against the exact solution. 


Step 6: The case when 0 = 0 yields an explicit time differencing scheme. For various values 
of u, how does this new scheme compare with your numerical solution that you found in 
Step 2? 


Project: Wave Propagation in a Nonhomogeneous Medium 


So far everything that we have done has been for a medium that is homogeneous and 
the phase speed is constant. In this project you will numerically integrate the wave equation 
where the phase speed c; differs in two different regions. Different phase speeds can arise 
in a domain because it possesses different materials with different physical properties in 
different areas. Such problems are important in many disciplines from antenna theory to 
seismology. 

'The objective of this project is to find the numerical solution to the wave equation 

ag | 307g 
—c 


Ot? i Ox? 


+ d(a — €)d(t — 7), O0<a<L, 0<t, 


which satisfies the initial conditions g(x,0) = g(x, 0) = 0 for 0 < x < L, and the boundary 
conditions g(0,t) = g(L,t) = 0 for 0 < t. 

This problem enjoys several differences from previous problems. First, there will be 
different phase speeds: cı = 2 for 0 < x < 1 and c2 = 1 for 1 < x < L. In order to highlight 
the discontinuity in the phase speed, we will take L sufficiently large so that we have no 
reflections of that boundary. Second, we have introduced a source term at the point (£, 7). 
This source term is unique in the sense that it is an impulse forcing at the position z = € 
at time t = 7. The solution of a differential equation whose initial conditions reflect a 
system initially at rest and which is then subjected to an impulse forcing at a given time 
and position is called a Green's function. 


Step 1: Using simple centered time and spatial differencing, write a MATLAB code to 
numerically solve this problem. 

There are two special concerns here. How do you handle the change in c;? The simplest 
way is to introduce an array that depends on location that gives the correct value of ci. 
The second and more difficult question is how do you model the delta function? Equations 
6.1.21 and 6.1.22 provide some simple expressions for small but finite e. You should try 
them and see what works best. 


The Wave Equation 385 


Figure 8.5.8: The numerically computed Green's function associated with a source function located at 
€ = 2 and 7 = 0.5. There are two regions with different phase speeds c1 = 2for0« x < 1 and c2 = 1 
for 1 <x < L. The other parameters are Ax = 0.05, At = 0.005, and L = 20. The delta function is 
approximated by a Gaussian. 


Step 2: Once you have written and debugged your code, try it out on a situation with uni- 
form phase speed cı = cz = 1 and see what you find. Does it conform to your expectation? 


Step 3: You are ready to introduce the discontinuity in phase speed. Redo Step 2 but with 
different phase speeds in regions 0 « z « 1 and 1 « x « L. 


Step 4: Plot your results. You should see that, depending upon the values of the phase 
speeds, some of the wave motion is transmitted and reflected at the interface (as well as at 
the boundary « = 0). Give the history of the wave from the source as it first encounters 
the interface and then the wall and then the interface again. 


Further Readings 


King, G. C., 2009: Vibrations and Waves. Wiley, 228 pp. This book emphasizes the 
physical principles, rather than the mathematics. 


Koshlyakov, N. S., M. M. Smirnov, and E. B. Gliner, 1964: Differential Equations of Math- 
ematical Physics. North-Holland Publishing, 701 pp. See Part I. Detailed presentations of 
solution techniques. 


Morse, P. M., and H. Feshback, 1953: Methods of Theoretical Physics. McGraw-Hill Book 
Co., 997 pp. Chapter 11 is devoted to solving the wave equation. 


Taylor & Francis 
Taylor & Francis Group 


http://taylorandfrancis.com 


SOLUTION 


Chapter 9 
The Heat Equation 


In this chapter we deal with the linear parabolic differential equation 


— = a -— 9.0.1 

Ot Ox? ( ) 
in the two independent variables x and t. This equation, known as the one-dimensional 
heat equation, serves as the prototype for a wider class of parabolic equations 


Oru o?u o?u ðu ðu 
a(x, t) 573 RE b(2,t) 53i + e(z, thas = (aston Ox’ x) , (9.0.2) 


where b? = 4ac. It arises in the study of heat conduction in solids as well as in a variety 
of diffusive phenomena. The heat equation is similar to the wave equation in that it is also 
an equation of evolution. However, the heat equation is not “conservative” because if we 
reverse the sign of t, we obtain a different solution. This reflects the presence of entropy, 
which must always increase during heat conduction. 


9.1 DERIVATION OF THE HEAT EQUATION 


'To derive the heat equation, consider a heat-conducting homogeneous rod, extending 
from z = 0 to x = L along the z-axis (see Figure 9.1.1). The rod has uniform cross section 
A and constant density p, is insulated laterally so that heat flows only in the z-direction, 
and is sufficiently thin so that the temperature at all points on a cross section is constant. 
Let u(x,t) denote the temperature of the cross section at the point x at any instant of time 
t, and let c denote the specific heat of the rod (the amount of heat required to raise the 
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BE 


xX+Ax 
Figure 9.1.1: Heat conduction in a thin bar. 


temperature of a unit mass of the rod by a degree). In the segment of the rod between the 
cross section at x and the cross section at x + Az, the amount of heat is 


z-d-Ac 
Q(t) zii cpAu(s, t) ds. (9.1.1) 


On the other hand, the rate at which heat flows into the segment across the cross section 
at x is proportional to the cross section and the gradient of the temperature at the cross 
section (Fourier's law of heat conduction): 


i (9.1.2) 


where « denotes the thermal conductivity of the rod. The sign in Equation 9.1.2 indicates 
that heat flows in the direction of decreasing temperature. Similarly, the rate at which heat 
flows out of the segment through the cross section at x + Ax equals 


Aout + Az,t) 
Ox 


The difference between the amount of heat that flows in through the cross section at x and 
the amount of heat that flows out through the cross section at x+ Ax must equal the change 
in the heat content of the segment x < s < x + Az. Hence, by subtracting Equation 9.1.3 
from Equation 9.1.2 and equating the result to the time derivative of Equation 9.1.1, 


(9.1.3) 


aQ [^ ðu(s,t) 


m = m ds- kA Ou(a+ Ax,t) u(x,t) 


Ot Ox Ox 


(9.1.4) 
x 
Assuming that the integrand in Equation 9.1.4 is a continuous function of s, then by the 
mean value theorem for integrals, 


zdAx 
p^ Ou(s,t) | O Ou(S t). 


ET E ET , xz<€<a2+Az, (9.1.5) 


so that Equation 9.1.4 becomes 


Ou(£,t) ^ [Ou(r-c Azx,t)  Ou(z,t) 
Aq mec Da og V (9.1.6) 


Dividing both sides of Equation 9.1.6 by cpAx and taking the limit as Ax —> 0, 


Ou(z, t) 40^ u(z, t) 
= 9.1.7 
ata? (Pano 
with a? = &/(cp). Equation 9.1.7 is called the one-dimensional heat equation. The constant 


a? is called the diffusivity within the solid. 
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If an external source supplies heat to the rod at a rate f(r,t) per unit volume per unit 


time, we must add the term jv f (s, t) ds to the time derivative term of Equation 9.1.4. 
Thus, in the limit Az — 0, 


Qu(z, t) 4 0^ u(x,t) 
ot 7,53 


= F(z,t), (9.1.8) 


where F(z,t) = f(x,t)/(cp) is the source density. This equation is called the nonhomoge- 
neous heat equation. 


9.2 INITIAL AND BOUNDARY CONDITIONS 


In the case of heat conduction in a thin rod, the temperature function u(x,t) must 
satisfy not only the heat equation, Equation 9.1.7, but also how the two ends of the rod 
exchange heat energy with the surrounding medium. If (1) there is no heat source, (2) the 
function f(x), 0 < x < L describes the temperature in the rod at t = 0, and (3) we maintain 
both ends at zero temperature for all time, then the partial differential equation 


Ou u 
ae ER 0<a<L, 0 « t, (9.2.1) 


describes the temperature distribution u(x,t) in the rod at any later time 0 < t subject to 
the conditions 
u(x,0) = f(x), O0<a<L, (9.2.2) 


and 
u(0,t) = u(L,t) = 0, 0 « t. (9.2.3) 


Equations 9.2.2 and 9.2.3 describe the initial-boundary-value problem for this particular 
heat conduction problem; Equation 9.2.3 is the boundary condition while Equation 9.2.2 
gives the initial condition. Note that in the case of the heat equation, the problem only 
demands the initial value of u(x,t) and not u;(x,0), as with the wave equation. 

Historically most linear boundary conditions have been classified in one of three ways. 
The condition, Equation 9.2.3, is an example of a Dirichlet problem! or condition of the 
first kind. This type of boundary condition gives the value of the solution (which is not 
necessarily equal to zero) along a boundary. 

'The next simplest condition involves derivatives. If we insulate both ends of the rod so 
that no heat flows from the ends, then according to Equation 8.1.2 the boundary condition 
assumes the form 

Ou(0,t) | Ou(L,t) 
ðr | ðr 


= 0, 0 « t. (9.2.4) 
This is an example of a Neumann problem? or condition of the second kind. This type of 
boundary condition specifies the value of the normal derivative (which may not be equal to 
zero) of the solution along the boundary. 


1 Dirichlet, P. G. L., 1850: Über einen neuen Ausdruck zur Bestimmung der Dichtigkeit einer unendlich 
dünnen Kugelschale, wenn der Werth des Potentials derselben in jedem Punkte ihrer Oberflàche gegeben 
ist. Abh. Königlich. Preuss. Akad. Wiss., 99-116. 


? Neumann, C. G., 1877: Untersuchungen über das Logarithmische und Newton’sche Potential. 
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Finally, if there is radiation of heat from the ends of the rod into the surrounding 
medium, we shall show that the boundary condition is of the form 


Ou(0, t) 


a T hu(0,t) = a constant, (9.2.5) 


and 
ðu(L,t) 


Ox 
for 0 < t, where h is a positive constant. This is an example of a condition of the third kind 
or Robin problem? and is a linear combination of Dirichlet and Neumann conditions. To 
solve these problems you must understand the Sturm-Liouville problem which is presented 
in Chapter 11. For this reason we will deal with the Robin boundary conditions there. 


+ hu(L,t) = another constant (9.2.6) 


9.3 SEPARATION OF VARIABLES 


As with the wave equation, the most popular and widely used technique for solving 
the heat equation is separation of variables. Its success depends on our ability to express 
the solution u(x,t) as the product X(x)T(t). If we cannot achieve this separation, then the 
technique must be abandoned for others. In the following examples we show how to apply 
this technique. 


e Example 9.3.1 


Let us find the solution to the homogeneous heat equation 


oe emm Ose Lh. x (9.3.1) 
which satisfies the initial condition 
u(r,0)— f(x), O<a<L, (9.3.2) 
and the boundary conditions 
u(0,t) = u(L,t) 20, O<t. (9.3.3) 


This system of equations models heat conduction in a thin metallic bar where both ends are 
held at the constant temperature of zero and the bar initially has the temperature f(x). 

We shall solve this problem by the method of separation of variables. Accordingly, we 
seek particular solutions of Equation 9.3.1 of the form 


u(a,t) = X(z)T(t), (9.3.4) 


which satisfy the boundary conditions, Equation 9.3.3. Because 


Ou , 
a X (z)T"(t), (9.3.5) 


3 Robin, G., 1886: Sur la distribution de l'électricité à la surface des conducteurs fermés et des conduc- 
teurs ouverts. Ann. Sci. l'Ecole Norm. Sup., Ser. 3, 3, S1-S58. 
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and j 
= = X"(z)T(t), (9.3.6) 
Equation 9.3.1 becomes 
T' (t)X (x) = a? X" (z)T(t). (9.3.7) 


Dividing both sides of Equation 9.3.7 by a? X (z)T(t) gives 


T' X 
aT = xX == —A, (9.3.8) 


where — is the separation constant. Equation 9.3.8 immediately yields two ordinary dif- 
ferential equations: 
X" E AX — 0, (9.3.9) 


and 
T' c a?AT =0 (9.3.10) 


for the functions X (x) and T(t), respectively. 

We now rewrite the boundary conditions in terms of X (x) by noting that the boundary 
conditions are u(0,t) = X(0)T(t) = 0, and u(L,t) = X(L)T(t) = 0 for 0 « t. If we 
were to choose T(t) = 0, then we would have a trivial solution for u(x,t). Consequently, 
X(0) = X(L) — 0. 


We now solve Equation 9.3.9. There are three possible cases: A = —m?, A = 0, and 
A = k?. If A = —m? < 0, then we must solve the boundary-value problem 
X" —m?X — 0, X(0) = X(L) — 0. (9.3.11) 


The general solution to Equation 9.3.11 is 
X(x) = Acosh(mz) + B sinh(mz). (9.3.12) 
Because X(0) = 0, it follows that A = 0. The condition X(L) = 0 yields B sinh(m.L) = 0. 


Since sinh(mL) 4 0, B = 0, and we have a trivial solution for A < 0. 
If A = 0, the corresponding boundary-value problem is 


Ae 0, X(0) = X(L) = 0. (9.3.13) 


'The general solution is 
X(x) 2 C + Dr. (9.3.14) 


From X(0) = 0, we have that C = 0. From X(L) = 0, DL = 0, or D=0. Again, we obtain 
a trivial solution. 
Finally, we assume that A = k? > 0. The corresponding boundary-value problem is 
X"-E'X-0, X(0)j—X(L)-0. (9.3.15) 


'The general solution to Equation 9.3.15 is 


X(x) = Ecos(kx) + F sin(kz). (9.3.16) 
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Because X(0) = 0, it follows that E = 0; from X(L) = 0, we obtain Fsin(kL) = 0. 
For a nontrivial solution, F Z 0 and sin(kL) = 0. This implies that k L = na, where 


n —1,2,3,.... In summary, the z-dependence of the solution is 
X,(t) = Fy sin(77) (9.3.17) 


where A, = n?n? / L. 
Turning to the time dependence, we use Àn = n?2?/L? in Equation 9.3.10 


22,2 
qu D Tes. (9.3.18) 

'The corresponding general solution is 

an?z? 
Ta (t) = Gn exp (- T2 t) : (9.3.19) 
Thus, the functions 
229 

Un(a,t) = B, sin( 7) ew( = LL r) med 2:8 (9.3.20) 


where B, = F4G,, are particular solutions of Equation 9.3.1 and satisfy the homogeneous 
boundary conditions, Equation 9.3.3. 

Having found particular solutions to our problem, the most general solution equals a 
linear sum of these particular solutions: 


oo 22,2 
u(x,t) = > Bn sin(77) ew( z = ) ; (9.3.21) 
n=1 


The coefficient Bn is chosen so that Equation 9.3.21 yields the initial condition, Equation 
9.3.2, if t = 0. Thus, setting t = 0 in Equation 9.3.21, we see from Equation 9.3.2 that the 
coefficients B, must satisfy the relationship 


f(x) = 2.5. sin(“**) p 0<g<L. (9.3.22) 


This is precisely a Fourier half-range sine series for f(x) on the interval (0, L). Therefore, 
the formula 


2 ft . (NTE 
Bn = 2 f(z) sin( 777.) dz, n —1,2,3,... (9.3.23) 


gives the coefficients B,. For example, if L = m and u(z,0) = x(a — x), then 


2^ d 2 [7 d] el 
Bn = z x(n — x) sin(nx) dz = 2 | xsin(na) dx — Ji ax sin(nz) dx = pa. 
T Jo 0 T Jo nr 
(9.3.24) 
Hence, 
8 «3 sin[(2n — 1)z] — (2n—1)?at 
"M : 9.3.2 
uet = $3 SERE (9.3.25) 


n=1 
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Figure 9.3.1: The temperature u(x,t) within a thin bar as a function of position x and time a?t when we 
maintain both ends at zero and the initial temperature equals x(a — x). 


Figure 9.3.1 illustrates Equation 9.3.25 for various times. It was created using the 
MATLAB script: 


clear 
M = 20; dx = pi/25; dt = 0.05; 
% compute grid and initialize solution 
X = [0:dx:pi]; T = [0:dt:2]; 
u = zeros(length(T) , length (X)) ; 
XX = repmat(X,[length(T) 1]); TT = repmat(T’,[1 length(X)]); 
^4 compute solution from Equation 9.3.25 
for m - 1:M 

tempi = 2*m-1; coeff = 8 / (pi * tempi * tempi * tempi); 

u = u + coeff * sin(tempi*XX) .* exp(-tempi * tempi * TT); 
end 
surf(XX,TT,u) 
xlabel(’DISTANCE’ ,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel(’?U(X,T)’,’Fontsize’ ,20) 
Note that both ends of the bar satisfy the boundary conditions, namely that the temperature 
equals zero. As time increases, heat flows out from the center of the bar to both ends where 
it is removed. This process is reflected in the collapse of the original parabolic shape of the 
temperature profile toward zero as time increases. 


* 


e Example 9.3.2 
A slight variation on Example 9.3.1 is 
0 « t, (9.3.26) 


where 
u(x,0) = u(0,t)=0, and u(L,t)- 9. (9.3.27) 
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We begin by blindly employing the technique of separation of variables. Once again, we 
obtain the ordinary differential equations, Equation 9.3.9 and Equation 9.3.10. The initial 
and boundary conditions become, however, 


X(0) = T(0) = 0, (9.3.28) 


and 
X(L)T(t) — 0. (9.3.29) 


Although Equation 9.3.28 is acceptable, Equation 9.3.29 gives us an impossible condition 
because T(t) cannot be constant. If it were, it would have to equal zero by Equation 9.3.28. 

To find a way around this difficulty, suppose that we want the solution to our prob- 
lem at a time long after t£ — 0. From experience, we know that heat conduction with 
time-independent boundary conditions eventually results in an evolution from the initial 
condition to some time-independent (steady-state) equilibrium. If we denote this steady- 
state solution by w(x), it must satisfy the heat equation 


a^w" (a) = 0, (9.3.30) 
and the boundary conditions 
w(0)=0, and w(L)- 8. (9.3.31) 
We can integrate Equation 9.3.30 immediately to give 
w(x) = A + Bz, (9.3.32) 


and the boundary condition, Equation 9.3.31, results in 


w(x)- —. (9.3.33) 


Clearly, Equation 9.3.33 cannot hope to satisfy the initial condition; that was never 
expected of it. However, if we add a time-varying (transient) solution v(z,t) to w(x) so 
that 

u(x,t) = w(x) + v(z, t), (9.3.34) 


we could satisfy the initial condition if 
v(z, 0) = u(z,0) — w(x), (9.3.35) 
and v(z, t) tends to zero as t — oo. Furthermore, because w"(x) = w(0) = 0, and w(L) = 0, 


Ov 4 Pu 


= =a z L, 0«t 9.3.36 
Ji = 2 gym 0<2<L, « t, ( ) 


with the boundary conditions 


v(0,t) 2 v(L,t) 20, 0<t. (9.3.37) 
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We can solve Equation 9.3.35, Equation 9.3.36, and Equation 9.3.37 by separation of vari- 
ables; we did it in Example 9.3.1. However, in place of f(x) we now have u(z, 0) — w(x), or 
—w(z) because u(x,0) = 0. Therefore, the solution v(z, t) is 


= nox a? n?n? 
,t) = 3 B.sin( 777) t 9.3.38 
v(z, t) 2. sinl | ew( T2 ) ( ) 
with 
PN gs 2 qv @ 

Bn = al —w(x) sin(77) dx = a L i (=) dx (9.3.39) 

20, D? NTI zL naa" 20 
= i = (-1)"—. 9.3.40 
L? E sin( L ) nm cos L )|. c n ( ) 


Thus, the entire solution is 


Ox 20 SO(-1 naa a?n? 1? 
u(2,1) = 7-4 72 E sin( 7 )ew( rr. (9.3.41) 


The quantity a?t/ L? is the Fourier number. 
Figure 9.3.2 illustrates our solution and was created with the MATLAB script: 


clear 
M = 1000; dx = 0.01; dt = 0.01; 
^4 compute grid and initialize solution 
X = [0:dx:1]; T = [0:dt:0.2]; 
XX = repmat(X,[length(T) 1]); TT = repmat(T’,[1 length(X)]); 
u = XX; 
^4 compute solution from Equation 9.3.41 
sign = -2/pi; 
for m = 1:M 
coeff - sign/m; 
u = u + coeff * sin((m*pi)*XX) .* exp(-(n*m*pi*pi) * TT); 
sign - -sign; 
end 
surf(XX,TT,u); axis([O 1 O 0.2 O 1]); 
xlabel(C DISTANCE?,?Fontsize?,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel (’SOLUTION’ , ’Fontsize’ ,20) 
Clearly it satisfies the boundary conditions. Initially, heat flows rapidly from right to left. 
As time increases, the rate of heat transfer decreases until the final equilibrium (steady- 
state) is established and no more heat flows. 


e Example 9.3.3 


Let us find the solution to the heat equation 
ðu u 
ee een c. 
Ot Ox?’ 
subject to the Neumann boundary conditions 
Ou(0,t)  Ou(L, t) 
ðr — ðr 


Ocr«L, 0<t, (9.3.42) 


=0,  O«t, (9.3.43) 
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o o 
0 


SOLUTION 


Figure 9.3.2: The temperature u(z,t)/0 within a thin bar as a function of position z/L and time a?t/L? 
with the left end held at a temperature of zero and right end held at a temperature 0 while the initial 
temperature of the bar is zero. 


and the initial condition that 
u(x, 0) = 2, 0 « x « L. (9.3.44) 
We have now insulated both ends of the bar. 


Assuming that u(x,t) = X(x)T(t), 


(9.3.45) 


where we have presently assumed that the separation constant is negative. The Neumann 
conditions give u,(0,t) = X'(0)T(t) = 0, and u,(L,t) = X'(L)T(t) = 0 so that X'(0) = 
X'(L) — 0. 

'The boundary-value problem 


X" - k? X — 0, (9.3.46) 


and 
X'(0) 2 X'(L) 20 (9.3.47) 


gives the z-dependence. The solution to Equation 9.3.46 is 


a= cos (27) (9.3.48) 
where kn = nz /L and n = 1,2,3,.... 
'The corresponding temporal part equals the solution of 
2,2,.2 
T! +a? k?T, = T), + EET, Lg (9.3.49) 


L2 
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which is 


22:2 7:2 
T, (t) = An exp (-* = ) (9.3.50) 


'Thus, the product solution given by a negative separation constant is 


2,42 


2 
Un(a,t) = Xp(x)T,(t) = An cos(* 7) ew( = = ) : (9.3.51) 


Unlike our previous problems, there is a nontrivial solution for a separation constant 
that equals zero. In this instance, the z-dependence equals 


X(x) = Ax + B. (9.3.52) 


The boundary conditions X'(0) = X'(L) = 0 force A to be zero but B is completely free. 
Consequently, the z-dependence here is 


Xo(x) — 1. (9.3.53) 


Because T(t) = 0 in this case, the temporal part equals a constant that we shall take to be 
49/2. Therefore, the product solution corresponding to the zero separation constant is 


'The most general solution to our problem equals the sum of all of the possible solutions: 


Ao = noc an? r? 
u(x,t) = "3s + 5 An cos( L ) exp( T2 J : (9.3.55) 
n=1 


Upon substituting t = 0 into Equation 9.3.55, we can determine A,, because 


a) (9.3.56) 


u(z,0) =a2= E DX 


is merely a half-range Fourier cosine expansion of the function x over the interval (0, L). 
From Equation 5.1.22 and Equation 5.1.23, 


2 L 
A-r] zdz = L, (9.3.57) 
L Jo 
and 
A -2f o (272) a 2 LI? : Que A (ous, 2o 2L (-1)" — 1] 
” L T L T TL nen OUT nr AL o mr? ; 
(9.3.58) 
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7 Me 0 0 


oS! ANCE 


Figure 9.3.3: The temperature u(z, t)/ L within a thin bar as a function of position z/L and time a?t/L? 
when we insulate both ends. The initial temperature of the bar is x. 


because all of the even harmonics vanish and we may rewrite the odd harmonics using 
n = 2m — 1, where m = 1,2,3,4,.... 
Figure 9.3.3 illustrates Equation 9.3.59 for various positions and times. It was generated 

using the MATLAB script: 
clear 
M = 100; dx = 0.01; dt = 0.01; 
^ compute grid and initialize solution 
X = [0:dx:1]; T = [0:dt:0.3]; 
u = zeros(length(T),length(X)); u = 0.5; 
XX = repmat(X,[length(T) 1]); TT = repmat(T’,[1 length(X)]); 
^4 compute solution from Equation 9.3.59 
for m = 1:M 

tempi - (2*m-1) * pi; 

coeff = 4 / (tempi*tempi); 

u-7u- coeff * cos(tempil*XX) .* exp(-tempi * tempi * TT); 
end 
surf(XX,TT,u); axis([O 1 O 0.3 O 1]); 
xlabel(?DISTANCE?,"Fontsize?,20); ylabel(’TIME’,’Fontsize’ ,20) 
zlabel (’SOLUTION’ , ’Fontsize’ ,20) 


The physical interpretation is quite simple. Since heat cannot flow in or out of the rod 
because of the insulation, it can only redistribute itself. Thus, heat flows from the warm 
right end to the cooler left end. Eventually the temperature achieves a steady state when 
the temperature is uniform throughout the bar. 


e Example 9.3.4: Refrigeration of apples 


Some decades ago, shiploads of apples, going from Australia to England, deteriorated 
from a disease called “brown heart,” which occurred under insufficient cooling conditions. 
Apples, when placed on shipboard, are usually warm and must be cooled to be carried in 
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Figure 9.3.4: An apple suffering from “brown heart.” 


cold storage. They also generate heat by their respiration. It was suspected that this heat 
generation effectively counteracted the refrigeration of the apples, resulting in the “brown 
heart." 

This was the problem that induced Awbery* to study the heat distribution within a 
sphere in which heat is being generated. He first assumed that the apples are initially at a 
uniform temperature. We can take this temperature to be zero by the appropriate choice 
of temperature scale. At time t = 0, the skins of the apples assume the temperature 0 
immediately when we introduce them into the hold. 

Because of the spherical geometry, the nonhomogeneous heat equation becomes 


1 Ou x x)*S 


a Ot  r2ür r Or 


3 0<r<b, 0<t, (9.3.60) 
K 


where a? is the thermal diffusivity, b is the radius of the apple, « is the thermal conductivity, 
and G is the heating rate (per unit time per unit volume). 

If we try to use separation of variables on Equation 9.3.60, we find that it does not 
work because of the G/« term. To circumvent this difficulty, we ask the simpler question 
of what happens after a very long time. We anticipate that a balance will eventually be 
established where conduction transports the heat produced within the apple to the surface 
of the apple where the surroundings absorb it. Consequently, just as we introduced a steady- 
state solution in Example 9.3.2, we again anticipate a steady-state solution w(r) where the 
heat conduction removes the heat generated within the apples. The ordinary differential 


equation 
1 d / dw G 
= 9.3.61 

r? dr (r dr ) K ( ) 


gives the steady state. Furthermore, just as we introduced a transient solution that allowed 
our solution to satisfy the initial condition, we must also have one here, and the governing 


^ Awbery, J. H., 1927: The flow of heat in a body generating heat. Philos. Mag., Ser. 7, 4, 629-638. 
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equation is 


ðv a? Of 40v a? Q?(r v) 
Ot or? Or (« 5) vr Ore ^ (9o 62) 
Solving Equation 9.3.61 first, 
D 2 
cg EE (9.3.63) 
r 6k 


The constant D equals zero because the solution must be finite at r = 0. Since the steady- 
state solution must satisfy the boundary condition w(b) = 0, 


C=0+ —. (9.3.64) 
6K 


Turning to the transient problem, we introduce a new dependent variable y(r,t) = 
rv(r,t). This new dependent variable allows us to replace Equation 9.3.62 with 


Z =a? (9.3.65) 


which we can solve. If we assume that y(r,t) = R(r)T(t) and we only have a negative 
separation constant, the R(r) equation becomes 


2 
a +k?R=0, (9.3.66) 
dr? 
which has the solution 
R(r) = Acos(kr) + B sin(kr). (9.3.67) 


'The constant A equals zero because the solution, Equation 9.3.67, must vanish at r — 0 so 
that v(0,t) remains finite. However, because 0 = w(b) + v(b,t) for all time and v(b,t) = 
R(b)T(t) /b = 0, then R(b) = 0. Consequently, kn = nv /b, and 


Bn . /mnr n?n a t 
Un (r, t) = : sin( 5 ) ew( m ) : (9.3.68) 
Superposition gives the total solution, which equals 
G SUB. ?g2q?t 
u(r,t) = 04 ou r?) 4 5 : sin( 277) ew( 2 > Ji (9.3.69) 


n=1 


Finally, we determine the coefficients B, by the initial condition that u(r,0) = 0. 
Therefore, 


fires Af" les So -»j sim( 277) ee E eS ( : ) 1)". (9.3.70) 


NT K NT 


The complete solution is 


oo 


20b —1)" , /mmr n?n at 
u(r,t) 204 ie 5 ( 2 sin( 5 )ew( m ) (9.3.71) 
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'The first line of Equation 9.3.71 gives the temperature distribution due to the imposition 
of the temperature 0 on the surface of the apple while the second line gives the rise in the 
temperature due to the interior heating. 

Returning to our original problem of whether the interior heating is strong enough to 
counteract the cooling by refrigeration, we merely use the second line of Equation 9.3.71 
to find how much the temperature deviates from what we normally expect. Because the 
highest temperature exists at the center of each apple, its value there is the only one of 
interest in this problem. Assuming b = 4 cm as the radius of the apple, a?7G/K = 1.33 x 1075 
°C/s, and a? = 1.55 x 107? cm?/s, the temperature effect of the heat generation is very 
small, only 0.0232 °C when, after about 2 hours, the temperatures within the apples reach 
equilibrium. Thus, we must conclude that heat generation within the apples is not the 
cause of brown heart. 

We now know that brown heart results from an excessive concentration of carbon diox- 
ide and an insufficient amount of oxygen in the storage hold.? Presumably this atmosphere 
affects the metabolic activities that are occurring in the apple? and leads to low-temperature 
breakdown. 


Problems 
For Problems 1-5, solve the heat equation uz = a?u,4, 0 < x < T, 0 < t, subject to the 
boundary conditions that u(0,t) = u(z,t) = 0, 0 < t, and the following initial conditions 
for 0 « a « v. Then plot your results using MATLAB. 


1. u(z,0) = A, a constant 


2. u(x,0) = sin?(z) = [3sin(z) — sin(32)]/4 


B T, 0<a<7/2, 
ZEA m/2«m«m. 


For Problems 6-10, solve the heat equation u; = a?u44, 0 < x < m, 0 < t, subject to the 
boundary conditions that u,(0,¢) = uz(7,t) = 0, 0 < t, and the following initial conditions 
for 0 « x « v. Then plot your results using MATLAB. 

6. u(z,0) 21 

7. u(z,0) =x 


8. u(z,0) = cos?(z) = [1 + cos(22)]/2 


9. u(z,0) =m- 


5 Thornton, N. C., 1931: The effect of carbon dioxide on fruits and vegetables in storage. Contrib. 
Boyce Thompson Inst., 3, 219—244. 


6 Fidler, J. C., and C. J. North, 1968: The effect of conditions of storage on the respiration of apples. 
IV. Changes in concentration of possible substrates of respiration, as related to production of carbon dioxide 
and uptake of oxygen by apples at low temperatures. J. Hortic. Sci., A3, 429—439. 
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= To, 0<a<7/2, 
"n «9 = | 9 m/2«m«m. 


For Problems 11 and 12, solve the heat equation uz = a?u,4, 0 < x < m, 0 < t, subject 
to the following boundary conditions and initial condition. Then plot your results using 
MATLAB. 


11. u(0,t) = u(r, t) = To, O < t; u(z,0) = T1 Z To, 0 m «m 
12. u(0,t) = 0,u(z,t) = To, 0 < t; u(z,0) 2 To, 0« x «m 
13. The linearized Boussinesq equation? 


2 
oe oe O0<a<L, 0<t, 

governs the height of the water table u(x,t) above some reference point, where a? is the 
product of the storage coefficient times the hydraulic coefficient divided by the aquifer 
thickness. A typical value of a? is 10 m?/min. Consider the problem of a strip of land of 
width L that separates two reservoirs of depth hı. Initially the height of the water table 
would be hy. Suddenly we lower the reservoir on the right x = L to a depth hg [u(0,t) = hi, 
u(L,t) = he, and u(z, 0) = hi]. Find the height of the water table at any position x within 
the aquifer and any time t > 0. 


14. The equation 
Ou Pu 
Ot Ox?’ 
governs the height of the water table u(x,t). Consider the problem? of a piece of land that 
suddenly has two drains placed at the points x = 0 and x = L so that u(0,t) = u(L,t) = 0. 
If the water table initially has the profile u(z,0) = 8H(L?x — 31?z? + ALz? — 22*)/ L^, find 
the height of the water table at any point within the aquifer and any time t > 0. 


O0<a<L, 0<t, 


15. Solve the nonhomogeneous heat equation 


2 
LRA E 


H pz TT O0<a<l, 0<t, 
HH 


subject to the boundary conditions u,(0,t) = u4(1,t) = 0, 0 < t, and the initial condition 
u(x,0) = 2(1—22), 0 < x < 1. Hint: Note that any function of time satisfies the boundary 
conditions. 


16. Solve the nonhomogeneous heat equation 


Ou 8u 


Sp | gzz 7 Acos(wt), O<T<T, 0 « t, 


T See, for example, Van Schilfgaarde, J., 1970: Theory of flow to drains. Advances in Hydroscience, No. 
6, Academic Press, 81-85. 


8 For a similar problem, see Dumm, L. D., 1954: New formula for determining depth and spacing of 
subsurface drains in irrigated lands. Agric. Eng., 35, 726-730. 
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subject to the boundary conditions u,(0,t) = u,(m,t) = 0, 0 < t, and the initial condition 
u(r,0) = f(x), 0 « x< a. Hint: Note that any function of time satisfies the boundary 
conditions. 


17. Solve the nonhomogeneous heat equation 
ðu Pu T, 0<a< 7/2, jet 
Ot ðr? \r-r, mw/2<a<T,’ : 


subject to the boundary conditions u(0,t) = u(z,t) = 0, 0 < t, and the initial condition 
u(z,0)—20,0 «zx «m. Hint: Represent the forcing function as a half-range Fourier sine 
expansion over the interval (0, 7). 
18. A uniform conducting rod of length L and thermometric diffusivity a? is initially at 
temperature zero. We supply heat uniformly throughout the rod so that the heat conduction 
equation is 
20u ðu 

"s ~ at 
where P is the rate at which the temperature would rise if there was no conduction. If 
we maintain the ends of the rod at the temperature of zero, find the temperature at any 
position and subsequent time. How would the solution change if the boundary conditions 
became u(0,t) = u(L,t) = A # 0, 0 < t, and the initial condition reads u(x,0) = A, 
O0<a<L? 


P O0<a<L, 0<t, 


19. Find the solution of 
—— O<a<L, 0<t, 


with the boundary conditions u(0,t) = 1, and u(L,t) = 0, 0 « t, and the initial condition 
u(z,0)=0,0<a<L. 


20. Solve the heat equation in spherical coordinates 


Ot  r?ór 


2 2 92 
ae x) T 0<r<1, 0<t, 


subject to the boundary conditions lim,.,o |u(r,t)| < oo, and u(1,t) = 0, 0 < t, and the 
initial condition u(r,0) = 1, 0 € r « 1. Hint: Introduce a new independent variable 
v(r,t) 2 ru(r,t). 


21. In their study of heat conduction within a thermocouple through which a steady current 
flows, Reich and Madigan? solved the following nonhomogeneous heat conduction problem: 


o 9? 
s olg a J P ó(a — b), Ocrc«L, 0<t, O«b«L, 


9 Reich, A. D., and J. R. Madigan, 1961: Transient response of a thermocouple circuit under steady 
currents. J. Appl. Phys., 32, 294-301. 
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where J represents the Joule heating generated by the steady current and the P term 
represents the heat loss from Peltier cooling.!? Find u(x,t) if both ends are kept at zero 
[u(0,t) = u(L,t) = 0| and initially the temperature is zero [u(z, 0) = 0]. The interesting 
aspect of this problem is the presence of the delta function 6(-). 


Step 1: Assuming that u(x, t) equals the sum of a steady-state solution w(x) and a transient 
solution v(z,t), show that the steady-state solution is governed by 
,d^w 


a ga PXs-b)-J w(0) = w(L) = 0. 


Step 2: Show that the steady-state solution is 


wg Jaz(L — z)/2a? + Az, 0 «cz «b, 
^ | Jz(L — 2)/2a? + B(L — x), b<a<L. 


Step 3: The temperature must be continuous at x = b; otherwise, we would have infinite 
heat conduction there. Use this condition to show that Ab = B(L — b). 


Step 4: To find a second relationship between A and B, integrate the steady-state differ- 
ential equation across the interface at x = b and show that 


Step 5: Using the result from Step 4, show that A + B = —P/a?, and 


Gs Jx(L — x)/2a? — Px(L — b)/a?L, 0cz«b, 
OTS) Ja(L — 2)/2a? — Pb(L — x)/a2L, b<a<L. 


Step 6: Re-express w(x) as a half-range Fourier sine expansion and show that 


_ AIL? QS sin(2m — 1)yz/L] | 2LP Q sin(nzb/ L) sin(nma/ L) 


w(x“) = i 
T em (2m — 1)? arn? £— n? 


Step 7: Use separation of variables to find the transient solution by solving 


Ov | $40?v 


— —a — L t 
ET a aD? O<a<L, 0<t, 


subject to the boundary conditions v(0,t) = v(L,t) = 0, 0 < t, and the initial condition 
v(z,0) = —w(r),0 < x < L. 


10 In 1834 Jean Charles Athanase Peltier (1785-1845) discovered that there is a heating or cooling 
effect, quite apart from ordinary resistance heating, whenever an electric current flows through the junction 
between two different metals. 
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Step 8: Add the steady-state and transient solutions together and show that 


_ 4JL SS sin((2m - 1)r2/L] i eene 
a?m3 £— (2m — 1)? 


2LP «5 sin(nzb/ L) sin(nzz/ L) Sip ea 
J [2 € | à 
9.4 THE SUPERPOSITION INTEGRAL 


Let us solve the heat condition problem 


Ou | Pu 


Bp = agn O0<a<L, 0<t, (9.4.1) 
with the boundary conditions 
u(0,t)=0, u(L,t)=f(t), O«t, (9.4.2) 
and the initial condition 
u(r,0 20, O<a<L. (9.4.3) 


'The solution of Equation 9.4.1 through Equation 9.4.3 is difficult because of the time- 
dependent boundary condition. Instead of solving this system directly, let us solve the easier 


problem 
ðA A 


RS 332: 0<a<L, 0 « t, (9.4.4) 
with the boundary conditions 
A(0,2) 20, A(L,t)=1, 0<t, (9.4.5) 
and the initial condition 
A(x, 0) = 0, 0 « x « L. (9.4.6) 
Separation of variables yields the solution 
zo 2«-(-1*, sna an? nt 
A(z,t) = L + = 5 " sin( 7 )ew( T2 : (9.4.7) 


n=l 


Consider the following case. Suppose that we maintain the temperature at zero at the 
end z = L until t = 7; and then raise it to the value of unity. The resulting temperature 
distribution equals zero everywhere when t < 7; and equals A(x, t— 71) for t > 7;. We have 
merely shifted our time axis so that the initial condition occurs at t = 71. 

Consider an analogous, but more complicated, situation of the temperature at the end 
position x = L held at f(0) from t = 0 to t = 71, at which time we abruptly change it by 
the amount f(71) — f(0) to the value f(71). This temperature remains until t = T2 when 
we again abruptly change it by an amount f(r2) — f(ri). We can imagine this process 
continuing up to the instant t = Tn. Because of linear superposition, which we introduced 
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in Section 8.3, the temperature distribution at any given time equals the sum of these 
temperature increments: 


u(x,t) = f(0)A(z,t) + [f(r1) - FOJA, t — r1) + [f(2) - fer] AG t — 72) 
Foe (E(t) dS AGE — Ta), (9.4.8) 


where Tn is the time of the most recent temperature change. If we write 
Afi, = f(x) — f(te-1), and Ate = Tk — Th-1, (9.4.9) 


Equation 9.4.8 becomes 


n 


u(x,t) = f(0)A(a,t) + XC A(a,t — Te) AD An. (9.4.10) 


k=1 


Consequently, in the limit of Av, — 0, Equation 9.4.10 becomes 


u(x,t) = f(0) A(z, t) «f A(a,t — T)f'(7) dr, (9.4.11) 


assuming that f(t) is differentiable. Equation 9.4.11 is the superposition integral. We can 
obtain alternative forms by integration by parts: 


u(x,t) = f(t) A(z, 0) - f fo Hej DAL D) dr, (9.4.12) 


u(x,t) = A(x, 0) «f fo f(r) ———— dr, (9.4.13) 


because BA(s,t BA(,t 
ger ae rz,t—T 
T = a (9.4.14) 


To illustrate’! the superposition integral, suppose f(t) = t. Then, by Equation 9.4.11, 


2,42 


^i ' 23 a sin(777) ew a as (t n j dr (9.4.15) 
ux lS > sin(” a f ew( e (9.4.16) 


Consider now the heat conduction problem with time-dependent forcing and/or bound- 
ary conditions: 


u(z, t) 


I 


— = a?L(u) + F(P,t), 0 « t, (9.4.17) 


B(u-g(Q.t)  0«t, (9.4.18) 


11 This occurs, for example, in McAfee, K. B., 1958: Stress-enhanced diffusion in glass. I. Glass under 
tension and compression. J. Chem. Phys., 28, 218-226. McAfee used an alternative method of guessing 
the solution. 
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and 

u(P,0) = h(P), (9.4.19) 

where 

o Ou o Ou o Ou 
L = } t 4. 
(u) =Co+ Ci x (K: a) + C2 rm (ss u C3 s ( 2) ; (9.4.20) 
Ou Ou Ou 

B(u) = co + cı CUTE C2 Baa C3 ar (9.4.21) 


P denotes an arbitrary interior point at (21, £2, £3) of a region R, and Q is any point on 
the boundary of R. Here c;, Ci, and K; are functions of x1, x2, and z3 only. 

Bartels and Churchill? extended Duhamel's theorem to solve this heat conduction 
problem. They did this by first introducing the simpler initial-boundary-value problem: 


Ov 


Poy a? L(v) + F(P, ti), 0 « t, (9.4.22) 
B(v)-g(Q i, | 0«t, (9.4.23) 

and 
v(P,0) = h(P), (9.4.24) 


which has a constant forcing and boundary conditions in place of the time-dependent ones. 
Here tı denotes an arbitrary but fired instant of time. Then Bartels and Churchill proved 
that the solution to the original problem is given by the convolution integral 


u(P,t) = M n v(P,t—T,T)dr|. (9.4.25) 


e Example 7.4.1 


Let us resolve Equation 9.4.1 through Equation 9.4.3 using Equation 9.4.25. 
We begin by solving the auxiliary problem Equation 9.4.22 through Equation 9.4.24: 


Ov ,9?v 


a | Age 0<a<L, 0<t,t, (9.4.26) 
subject to the boundary conditions 
v(0,5,5) 20, v(L,t.4)=f(th),  0«tt, (9.4.27) 


and the initial condition v(z,0,t1) — 0, 0 « x « L. 
'The heat condition problem Equation 9.4.26 and Equation 9.4.27 can be solved using 
separation of variables where u(x,t, t1) = w(z,t1) + 0(2,t, tı), 


ww" Co; fi) — 0, w(0,41) 20, w(L,t1) = f(t), 0 « x «L, (9.4.28) 


12 Bartels, R. C. F., and R. V. Churchill, 1942: Resolution of boundary problems by the use of a 
generalized convolution. Am. Math. Soc. Bull., 48, 276—282. 
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and 
Pic A 0 L, 0<t,t (9.4.29 
oath 0cecl, Oct, 429) 
subject to the boundary conditions 
0(0, t, tı) = O(L, t, tı) =0, 0< t, ti, (9.4.30) 


and the initial condition 0(x,0, t1) = —w(x, t1), 0 « x < L. This yields the solution that 


tis 2 ^ (—1)* . (NTE an? nt 
v(r, t,t) = fus + f(t) 5 ( > sin( 2) ap(- T2 ) f (9.4.31) 
n=1 
Therefore, 
fa) t 
u(x,t) = ET n v(z,t— T,T) ar| : (9.4.32) 
Using the Leibniz rule and the fact that v(z,0,t,) = 0, 
t 
T 
u(z,t) = J AE (9.4.33) 
0 Ot 


Substituting Equation 9.4.31 into Equation 9.4.33, we finally have that 


2a?g 4 . (NTE an? n’ t : 5 an? nr 
u(x,t) = — I > nsin( L )ew( I TAE 1) f) es ( 02 ) ar 


(9.4.34) 
Problems 
1. Solve the heat equation!? 
o ə? 
a oat” 0O<gr<L, 0<t, 


subject to the boundary conditions u(0,t) = u(L,t) = f(t), 0 < t, and the initial condition 
u(r,0)—0,0« x « L. 


Step 1: First solve the heat conduction problem 


0A 407A 


— =a > 0 L, O<t 
at a 328" <T< L, <t, 


subject to the boundary conditions A(0,t) = A(L,t) = 1, 0 < t, and the initial condition 
A(x,0) 2 0, 0 «€ x< L. Show that 


4 & sin[(2n — l)rz/L] | 204 142r? 
A(x,1)21 X a? (2n—1)°n?t/ L? 
gon) T 2n— 1 : 


n=1 


13 See Tao, L. N., 1960: Magnetohydrodynamic effects on the formation of Couette flow. J. Aerosp. Sci., 
27, 334-338. 
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Step 2: Use Duhamel's theorem and show that 


2 œ t 
u(x,t) = ae (2n — 1) sin| E T Quee Dee i fet CP le dr. 
0 


n=1 


2. Solve the heat equation 


o ə? 
S pa = tinle), O<a<n, Oct, 

subject to the boundary conditions u(0,t) = u(z,t) = 0, 0 < t, and the initial condition 
u(r,0) =0,0<a<7. 


Step 1: First solve the heat conduction problem 


ð 9? 
Or g 7 hein), O<a<n, 0<t,tı, 

subject to the boundary conditions v(0,t,t1) = v(m,t,ti) = 0, 0 < t, t, and the initial 
condition v(x, 0,t1) — 0, 0 <a « v. Show that v(z,t, t1) = tı sin(x) — tı sin(z)e *. 


Step 2: Use Equation 9.4.25 to show that the solution to our original problem is u(x,t) = 
(t — 12- e^) sin(z). 


9.5 NUMERICAL SOLUTION OF THE HEAT EQUATION 


In addition to separation of variables, linear heat equations can also be solved using 
transform methods (see, for example, Section 6.8). However, when this analytic technique 
fails or we have a nonlinear heat equation, we must resort to numerical techniques. This 
section develops some of these techniques. 

Starting with the heat equation 


Ou O7u 
Ot = a X3 (9.5.1) 


we must first replace the exact derivatives with finite differences. Drawing upon our work 
in Section 8.5, 
Ou(rs,t,) | utt — u? 


S dp - O(At), (9.5.2) 


and j 
Ó Ulm, tn) mu Um+1 aa 2uim ar Um—1 2 
p (AI + O[( A3], (9.5.3) 


where the notation u7, denotes u(%m,tn). Figure 9.5.1 illustrates our numerical scheme 
when we hold both ends at the temperature of zero. Substituting Equation 9.5.2 and 
Equation 9.5.3 into Equation 9.5.1 and rearranging, 


n4-1 n a? At n n n 
ue Sut (Azy (un, i4 — Um + un, 1). (9.5.4) 
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Figure 9.5.1: Schematic of the numerical solution of the heat equation when we hold both ends at a 
temperature of zero. 
The numerical integration begins with n = 0 and the value of u2, ,,, u9,, and u?,_, are 
given by f(mAmx). 

Once again we must check the convergence, stability, and consistency of our scheme. We 
begin by writing u5,,4, uj. ,, and u"*1 in terms of the exact solution u and its derivatives 
evaluated at the point £m = mAz and tn = nAt. By Taylor's expansion, 


5 d DD ı gout - a sow 
nui = 5 Ax. ot 5 (Ax) pj. ^ g (Az) n. 2 (9.5.5) 
i " e y e 0u” i su|” 
up c = uh Arz A + 5(Az) T g (Az) oss | Fe (9.5.6) 
and au ga "M 
mE La LAGU p AaS Lap © 9.5.7 
unt! = uh + MEST] + HON? Se] MAD TES + (9.5.7) 
Substituting into Equation 9.5.4, we obtain 
unt — Um 2Um41 — 2Um + Um—1 
At (Ax)? 
ðu xD V 1, Pul” ay 
= + 5A L(aAx) D +--+. (9.5.8 
(s á a) iF aoe. aoe aa RSS) 


The first term on the right side of Equation 9.5.8 vanishes because u(x,t) satisfies the heat 
equation. Thus, in the limit of Az — 0, At > 0, the right side of Equation 9.5.8 vanishes 
and the scheme is consistent. 

To determine the stability of the explicit scheme, we again use the Fourier method. 


Assuming a solution of the form: MM 
UR = gum. (9.5.9) 


we substitute Equation 9.5.9 into Equation 9.5.4 and find that 


ei^ —1 ,€9 —2 +e” 
At (Ar) ^ 


(9.5.10) 
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at 
Figure 9.5.2: The growth of error ||es|| as a function of a?t for various resolutions. For the top line, 
Ax = 0.1; for the middle line, Ax = 0.01; and for the bottom line, Az = 0.001. 


Or 
2 

Dd a“At . (0 

e*=1 4 sin (5) ; (9.5.11) 
The quantity et^ will grow exponentially unless 

a? At 0 
1<1-4 in? 1 9.5.12 
<1- (3) < vee 


The right inequality is trivially satisfied if a?2At/(Az)? > 0, while the left inequality yields 


a? At 1 


(Ax)? = 2sin? (0/2)’ [Pd 


leading to the stability condition 0 < a?At/(Ax)? € 3. This is a rather restrictive condition 
because doubling the resolution (halving Ax) requires that we reduce the time step by a 
quarter. Thus, for many calculations, the required time step may be unacceptably small. For 
this reason, many use an implicit form of the finite differencing (Crank-Nicholson implicit 
method!4): 


n+1 n 2 n _ n n ag! — n+1 n+1 
Um — Um e a Um+1 2Uum + Um—1 f Um+1 2u TUS 


Ni 2 (Ax)? i (Ax)? 


although it requires the solution of a simultaneous set of linear equations. However, there 
are several efficient methods for their solution. 

Finally we must check and see if our explicit scheme converges to the true solution. If 
we let ep, denote the difference between the exact and our finite differenced solution to the 
heat equation, we can use Equation 9.5.8 to derive the equation governing c7, and find that 


(9.5.14) 


en ced (Ax)? (Cini — 265, + €i) + O[(At)* + At(Ac)’], (9.5.15) 


for m = 1,2,..., M. Assuming that a?At/(Az)? < 2, then 


14 Crank, J., and P. Nicholson, 1947: A practical method for numerical evaluation of solutions of partial 
differential equations of the heat-conduction type. Proc. Cambridge. Philos. Soc., A3, 50-67. 
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Figure 9.5.3: The numerical solution u(x,t) of the heat equation with a?At/(Az)? = 0.47 at various 
positions a’ = v/L and times t’ = a?t/L? using Equation 9.5.4. The initial temperature u(x,0) equals 
4x'(1 — z') and we hold both ends at a temperature of zero. 


a a?At ) » OP AT] us At acus 
UE (Ax)? Jhal + Í 7 s] emt (Ax)? [Erg PARA hay] 

(9.5.16) 
< |len|| + A[(At)? + At(Az)?], (9.5.17) 

where ||en|| 2 maxXm=o,1,..., |e% |. Consequently, 
llena] < |len|| + A[(At)? + At(Az)?]. (9.5.18) 

Because ||eo|| = 0 and nAt € tn, we find that 

[len+i|| € An[(At)? + At(Ax)?] € At, [At + (Ax)?]. (9.5.19) 


As Az — 0, At > 0, the errors tend to zero and we have convergence. We have illustrated 

Equation 9.5.19 in Figure 9.5.2 by using the finite difference equation, Equation 9.5.4, to 

compute ||en|| during a numerical experiment that used a2At/(Az)? = 0.5, and f(x) = 

sin(x). Note how each increase of resolution by 10 results in a drop in the error by 100. 
The following examples illustrate the use of numerical methods. 


e Example 9.5.1 


For our first example, we redo Example 9.3.1 with a?2At/(Az)? = 0.47 and 0.53. Our 
numerical solution was computed using the MATLAB script: 
clear 
coeff = 0.47; % coeff = a?At/(Az)? 
ncount = 1; dx = 0.1; dt = coeff * dx * dx; 
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Figure 9.5.4: Same as Figure 9.5.3 except that a?At/(Ax)? = 0.53. 


N 99; x = O:dx:1; 
M = 1/dx + 1; 4 M = number of spatial grid points 
tplot(1) = 0; u = zeros(M,N+1); 
for m = 1:M; u(m,1)-4*xx(m)*(1-x(m)); temp(m,1)=u(m,1); end 
^ integrate forward in time 
for n = 1:N 
t = dt * n; 
for m = 2:M-1 
u(m,n+1) = u(m,n) + coeff*(u(m*1,n)-2xu(m,n)*u(m-1,n)); 
end 
if mod(n+1,2) == 
ncount = ncount + 1; tplot(ncount) = t; 
for m = 1:M; temp(m,ncount) = u(m,n*1); end 
end; end 
^4 plot the numerical solution 
X = x’ * ones(1,length(tplot)); T = ones(M,1) * tplot; 
surf(X,T,temp) 
xlabel(’DISTANCE’ ,’Fontsize’,20); ylabel(’TIME’,’Fontsize’ ,20) 
zlabel (’ TEMPERATURE’ , ’Fontsize’ ,20) 
As Figure 9.5.3 shows, the solution with a2At/(Az)? < 1/2 performs well. On the other 
hand, Figure 9.5.4 shows small-scale, growing disturbances when a?At/(Azx)? > 1/2. It 
should be noted that for the reasonable Az = L/100, it takes approximately 20,000 time 
steps before we reach a?t/ L? = 1. 


e Example 9.5.2 


In this example, we redo the previous example with an insulated end at « = L. Using 
the centered differencing formula, 


UM+1 — UM-1 = 9, (9.5.20) 


414 Advanced Engineering Mathematics with MATLAB 


TEMPERATURE 


0.5 
0.4 


0.3 
0.2 


0.1 
S 1 0 TIME 
Figure 9.5.5: Same as Figure 9.5.3 except that we now have an insulated boundary condition uz(L,t) = 0. 


because u, (L,t) = 0. Also, at i= M, 


a2 At 
us = um + TAr) (uiy — 2u + uM1) f (9.5.21) 


Eliminating uñ; between the two equations, 


2A 
TL T a t T TL 


To implement this new boundary condition in our MATLAB script, we add the line 
u(M,nt1) = u(M,n) + 2 * coeff * (u(M-1,n) - u(M,n)); 
after the lines 
for m = 2:M-1 
u(m,nti) = u(m,n) + coeff * (u(mti,n) - 2 * u(m,n) + u(m-1,n)); 
end 


Figure 9.5.5 illustrates our numerical solution at various positions and times. 
Project: Implicit Numerical Integration of the Heat Equation 


The difficulty in using explicit time differencing to solve the heat equation is the very 
small time step that must be taken at moderate spatial resolutions to ensure stability. This 
small time step translates into an unacceptably long execution time. In this project you will 
investigate the Crank-Nicholson implicit scheme, which allows for a much more reasonable 
time step. 


Step 1: Develop a MATLAB script that uses the Crank-Nicholson equation, Equation 9.5.14, 
to numerically integrate the heat equation. To do this, you will need a tridiagonal solver to 
find u**!. This is explained at the end of Section 3.1. However, many numerical methods 
books!? actually have code already developed for your use. You might as well use this code. 


15 For example, Press, W. H., B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, 1986: Numerical 
Recipes: The Art of Scientific Computing. Cambridge University Press, Section 2.6. 
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Figure 9.5.6: The numerical solution u(x,t) of the heat equation uz = Ure using the Crank-Nicholson 
method. The parameters used in the numerical solution are a? At = 0.005 and Ax = 0.05. Both ends are 
held at zero with an initial condition of u(z,0) = 0 for 0 < z < i and u(xz,0) = 1 for i <@ <1. 


Step 2: Test your code by solving the heat equation given the initial condition u(x,0) = 
sin(7x), and the boundary conditions u(0,t) = u(1,t) = 0. Find the solution for various 
values of At with Az = 0.01. Compare this numerical solution against the exact solution 
that you can find. How does the error (between the numerical and exact solutions) change 
with At? For small At, the errors should be small. If not, then you have a mistake in your 
code. 


Step 3: Once you have confidence in your code, discuss the behavior of the scheme for 
various values of Ax and At for the initial condition u(z,0) = 0 for 0 € x < 2, and 
u(x,0) = 1 for i < x € 1 with the boundary conditions u(0,t) = u(1,t) = 0. See Figure 
9.5.6. Although you can take quite a large At, what happens? Did a similar problem arise 
in Step 2? Explain your results.!Ó Zvan et al!" have reported a similar problem in the 
numerical integration of the Black-Scholes equation (another parabolic partial differential 
equation) from mathematical finance. 


Project: Saulyev's Explicit Methods for the Heat Equation 
In 1957 V. K. Saulyev!? suggested that Equation 9.5.3 be replaced by 


2 n n n+l n+1 
F ulEm,tn) diia cup — Um + a 


Ox? a (Ax)? ' 


16 Luskin, M., and R. Rannacher, 1982: On the smoothing property of the Crank-Nicolson scheme. 
Applicable Anal., 14, 117—135. 


17 Zvan, R., K. Vetzal, and P. Forsyth, 1998: Swing low, swing high. Risk, 11(3), 71-75. 


18 Saulyev, V. K., 1964: Integration of Equations of Parabolic Type by the Method of Nets. Pergamon 
Press, 365 pp. 


416 Advanced Engineering Mathematics with MATLAB 


if we have a Dirichlet condition along left side, or 


Pu(rm, tn) = AAT -Um — Um tUm 
Ox? (Ax)? f 


if we have a Dirichlet condition along right side. Therefore, Equation 9.5.4 becomes 


(1+ 0u = Ourth + (1— 0)u, + bur) 


in the first case, and 
(L +0jum = bumpa + (1— Oum + Oum 


in the second case. Here 0 = a?At/(Az)?. These are actually explicit schemes since the 
value at ut! or ut} is either known from the boundary condition or has just been 
computed. It can be shown that!? (1) these schemes are unconditionally stable and (2) 


consistency requires that At tends to 0 faster than Ax. 


Step 1: Using Example 9.3.1, compare the exact solution Equation 9.3.25 with the numerical 
solution given by Saulyev's schemes when you scan from left to right as a function of 0. In 
particular, examine the relative error as a function of position and time. 


Step 2: Redo Step 1 but now scan from right to left. 


Step 3: Saulyev himself did not advise (on page 29 of his book) just employing one method 
or the other, but suggested using them alternatively, such as one for the odd (time) steps 
and the other in the even (time) steps. Take his advice and test out his suggestion by 
redoing Step 1 using his suggestion. 


Project: Numerical Solution of the Heat Equation 
with a Non-Local Boundary Condition 


In the solution of the heat equation in this chapter, we have always had two boundary 
conditions, one at r — 0 and one at z — L. However, in the design of photoelectric cells, 
the electric signal generated in the cell is proportional to S u(x,t) dz, where u(x, t) denotes 
the concentration of the chemical present at the location x and time t. The concentration, 
in turn, depends upon the diffusion of the chemical as a light beam passes through the tube 
at right angles between x = 0 and x = b. 

To model this concentration we must solve the diffusion equation 


ðu Ou 


SEC np 0<a<L, 0 « t, 


subject to the constraints that 


T u(z,t) dx = M(t), 
0 


19 Østerby, O., 2017: On Saulyev’s methods. DAIMI Report Series, 43(599), 11 pp. http: tidsskrift.dk 
/ daimipb/article/view/26410/23231 
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Figure 9.5.7: The error between a numerical and exact solution for a heat equation with a non-local 
boundary condition as a function of position x and time t. Here L = 1, b = 1/2, Ax = 0.05, and 
At = 0.00025 so that 0 = 0.1. 


where 0 < b < L. Of course, we have the initial condition that 
u(x,0) = f(a), 0<a<L. 


The integral constraint is referred to as a non-local boundary condition. 

To keep this project simple, let us integrate the diffusion equation using an explicit 
time differencing scheme. Assuming the x; = iAz and tn = nAt, where i = 0,1,2,...,M 
and n = 0,1,2,..., we have that 


ult! — uP + (um, — Qu? +a), 19523) 


with i = 1,2,3,..., M — 1, n = 0,1,2,... and Az = L/M. Here 0 = At/(Az)?. 

At x = L, we have that 

u? — yn 
un M-1 _ q(t,). 

This can be combined with the heat equation (Equation 9.5.23) to yield a predictive equation 
for the grid point i = M. 

The interesting aspect of this project is how to predict the value of ups. Employing 
Simpson's rule, the integral condition gives 


A 

ug?) Aut! + 2u7 + Aug boob Aunt + ut = = Mtn); 

where J = b/Ax and must be an even integer. In this scheme we first update the grid 
points from i = 1 to M and then use this equation to give ugt’. 


Step 1: Using this scheme, create a code to compute u7. Compare this scheme against the 


exact solution u(x,t) = t + z?/2, g(t) = 1 and M(t) = bt + 03/6. Figure 9.5.7 shows the 
error between the numerical solution and the exact solutions. 
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Step 2: Simpson's rule is not the only choice for an integration scheme. Redo Step 1 but 
use the trapezoidal rule. 


Further Readings 


Carslaw, H. S., and J. C. Jaeger, 1959: Conduction of Heat in Solids. Oxford University 
Press, 510 pp. The source book on solving the heat equation. 


Crank, J., 1970: The Mathematics of Diffusion. Oxford University Press, 347 pp. A source 
book on the solution of the heat equation. 


Koshlyakov, N. S., M. M. Smirnov, and E. B. Gliner, 1964: Differential Equations of Math- 
ematical Physics. North-Holland Publishing, 701 pp. See Part III. Nice presentation of 
mathematical techniques. 


Morse, P. M., and H. Feshback, 1953: Methods of Theoretical Physics. McGraw-Hill Book 
Co., 997 pp. A portion of Chapter 12 is devoted to solving the heat equation. 


Chapter 10 


Laplace's Equation 


In the previous chapter we solved the one-dimensional heat equation. Quite often we 
found that the transient solution died away, leaving a steady state. The partial differential 
equation that describes the steady state for two-dimensional heat conduction is Laplace's 
equation 

Ou Ou 
tun. 10.0.1 
Ox? Oy? ( ) 


In general, this equation governs physical processes where equilibrium has been reached. It 
also serves as the prototype for a wider class of elliptic equations 


2 2 2 
a(z, Te + bos, t) oe + c(z,t) — = s(a tu S a) ; (10.0.2) 


where b? < 4ac. Unlike the heat and wave equations, there are no initial conditions and 
the boundary conditions completely specify the solution. In this chapter we present some 
of the common techniques for solving this equation. 


10.1 DERIVATION OF LAPLACE'S EQUATION 


Imagine a thin, flat plate of heat-conducting material between two sheets of insulation. 
Sufficient time has passed so that the temperature depends only on the spatial coordinates 
x and y. Let us now apply the law of conservation of energy (in rate form) to a small 
rectangle with sides Ax and Ay. 


419 
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If qz (x, y) and q,(x, y) denote the heat flow rates in the z- and y-direction, respectively, 
conservation of energy requires that the heat flow into the slab equals the heat flow out of 
the slab if there is no storage or generation of heat. Now 


rate in = qz(z, y + Ay/2)Ay + qy(z + Az/2, y)Ax, (10.1.1) 


and 
rate out = qz(z + Az, y + Ay/2)Ay + qy(x + Av/2,y + Ay)Ac. (10.1.2) 


If the plate has unit thickness, 
[as (z, y + Ay/2) — a (x + Av, y + Ay/2)|Ay 
+ [gy (x  Ax/2,y) — ay(x + Av/2, y + Ay)| Ax = 0. (10.1.3) 


Upon dividing through by AxAy, we obtain two differences quotients on the left side of 
Equation 10.1.3. In the limit as Az, Ay — 0, they become partial derivatives, giving 
Ode | O 
Qe | Oy _ 
Ox Oy 


0 (10.1.4) 


for any point (x, y). 
We now employ Fourier's law to eliminate the rates q; and qy, yielding 


ð f ðu ð f ðu) | 
x (« a) + Dy (« 5) — 0, (10.1.5) 


if we have an isotropic (same in all directions) material. Finally, if a? is constant, Equation 
10.1.5 reduces to 


Ou du 


which is the two-dimensional, steady-state heat equation (i.e., u; œ 0 as t — oc). 

Solutions of Laplace's equation (called harmonic functions) differ fundamentally from 
those encountered with the heat and wave equations. These latter two equations describe 
the evolution of some phenomena. Laplace’s equation, on the other hand, describes things 
at equilibrium. Consequently, any change in the boundary conditions affects to some degree 
the entire domain because a change to any one point causes its neighbors to change in order 
to reestablish the equilibrium. Those points will, in turn, affect others. Because all of these 
points are in equilibrium, this modification must occur instantaneously. 

Further insight follows from the maximum principle. If Laplace's equation governs a 
region, then its solution cannot have a relative maximum or minimum inside the region 
unless the solution is constant.! If we think of the solution as a steady-state temperature 
distribution, this principle is clearly true because at any one point, the temperature cannot 
be greater than at all other nearby points. If that were so, heat would flow away from the 
hot point to cooler points nearby, thus eliminating the hot spot when equilibrium was once 
again restored. 

It is often useful to consider the two-dimensional Laplace's equation in other coordinate 
systems. In polar coordinates, where « = rcos(0), y = rsin(0), and z = z, Laplace’s 
equation becomes 

0?u , 10u Pu 
ðr?  rór d 022 — 


0, (10.1.7) 


1 For the proof, see Courant, R., and D. Hilbert, 1962: Methods of Mathematical Physics, Vol. 2: 
Partial Differential Equations. Interscience, pp. 326—331. 
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Today we best remember Pierre-Simon Laplace (1749-1827) for his work in celestial mechanics and 
probability. In his five volumes Traité de Mécanique céleste (1799-1825), he accounted for the 
theoretical orbits of the planets and their satellites. Laplace's equation arose during this study of 
gravitational attraction. (Portrait courtesy of the Archives de l'Académie des sciences, Paris.) 


if the problem possesses axisymmetry. On the other hand, if the solution is independent of 
z, Laplace's equation becomes 


u  10u 1 3u 
t = 0. 10.1. 
ðr? or Or * r? 00? i (10.1.8) 


In spherical coordinates, x = r cos(y) sin(0), y = r sin(q)sin(0), and z = r cos(0), where 
r? = x? + y? + z2, 0 is the angle measured down to the point from the z-axis (colatitude) 
and y is the angle made between the x-axis and the projection of the point on the zy plane. 
In the case of axisymmetry (no y dependence), Laplace's equation becomes 


3 / ðu 1 Of. Ou 
| — = uU. 1 nm 
Or (r x) sin(9) 00 E z : orm) 


10.2 BOUNDARY CONDITIONS 
Because Laplace's equation involves time-independent phenomena, we must only spec- 
ify boundary conditions. As we discussed in Section 9.2, we can classify these boundary 


conditions as follows: 


1. Dirichlet condition: u given 
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2. Neumann condition: On given, where n is the unit normal direction 
n 


o 
3. Robin condition: u + ax given 
n 


along any section of the boundary. In this chapter we will deal with Dirichlet and Neumann 
boundary conditions; problems with Robin conditions will be deferred to Chapter 11 because 
we must first study the Sturm-Liouville problem. In the case of Laplace's equation, if all 
of the boundaries have Neumann conditions, then the solution is not unique. This follows 
from the fact that if u(x, y) is a solution, so is u(x, y) + c, where c is any constant. 

Finally we note that we must specify the boundary conditions along each side of the 
boundary. These sides may be at infinity as in problems with semi-infinite domains. We 
must specify values along the entire boundary because we could not have an equilibrium 
solution if any portion of the domain was undetermined. 


10.3 SEPARATION OF VARIABLES 


As in the case of the heat and wave equations, separation of variables is the most 
popular technique for solving Laplace's equation. Although the same general procedure 
carries over from the previous two chapters, the following examples fill out the details. 


e Example 10.3.1: Groundwater flow in a valley 


Over a century ago, a French hydraulic engineer named Henri-Philibert-Gaspard Darcy 
(1803-1858) published the results of a laboratory experiment on the flow of water through 
sand. He showed that the apparent fluid velocity q relative to the sand grains is directly 
proportional to the gradient of the hydraulic potential — kV v, where the hydraulic potential 
y equals the sum of the elevation of the point of measurement plus the pressure potential 
(p/pg). In the case of steady flow, the combination of Darcy's law with conservation of 
mass V -q = 0 yields Laplace's equation Vy = 0 if the aquifer is isotropic (same in all 
directions) and homogeneous. 

To illustrate how separation of variables can be used to solve Laplace’s equation, we 
will determine the hydraulic potential within a small drainage basin that lies in a shallow 
valley. See Figure 10.3.1. Following Tóth,? the governing equation is the two-dimensional 
Laplace equation 


u Ou 
ap 9279 0<a<L, 0 « y € zo, (10.3.1) 
along with the boundary conditions 
u(x, 20) = 920 + gc, (10.3.2) 
us (0, y) = Ux(L, y) = 0, and uy(z,0) = 0, (10.3.3) 


where u(x, y) is the hydraulic potential, g is the acceleration due to gravity, and c gives the 
slope of the topography. The conditions u;(L,y) = 0, and u,(z,0) = 0 specify a no-flow 
condition through the bottom and sides of the aquifer. The condition u,(0, y) = 0 ensures 
symmetry about the x = 0 line. Equation 10.3.1 gives the fluid potential at the water table, 


2 Tóth, J., 1962: A theory of groundwater motion in small drainage basins in central Alberta, Canada. 
J. Geophys. Res., 67, 4375—4387. 
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Figure 10.3.1: Cross section of a valley. 


where zo is the elevation of the water table above the standard datum. The term gcx in 
Equation 10.3.2 expresses the increase of the potential from the valley bottom toward the 
water divide. On average it closely follows the topography. 

Following the pattern set in the previous two chapters, we assume that u(r,y) = 
X(x)Y (y). Then Equation 10.3.1 becomes 


X"Y + XY" =0. (10.3.4) 
Separating the variables yields 
AX. y" 


Both sides of Equation 10.3.5 must be constant, but the sign of that constant is not obvious. 
From previous experience we anticipate that the ordinary differential equation in the z- 
direction leads to a Sturm-Liouville problem because it possesses homogeneous boundary 
conditions. Proceeding along this line of reasoning, we consider three separation constants. 


Trying a positive constant (say, m?), Equation 10.3.5 separates into the two ordinary 
differential equations 


X" —m?X =0, and — Y". m?Y — 0, (10.3.6) 
which have the solutions 
X(x) = Acosh(mz) + B sinh(mz), (10.3.7) 
and 
Y (y) = C cos(my) + D sin(my). (10.3.8) 


Because the boundary conditions, Equation 10.3.3, imply X'(0) — X'(L) — 0, both A and 
B must be zero, leading to the trivial solution u(x, y) = 0. 

When the separation constant equals zero, we find a nontrivial solution given by 
Xo(r) = 1, and Yo(y) = Ao + Boy. However, because Yj(0) = 0 from Equation 10.3.3, 
Bo = 0. Thus, the particular solution for a zero separation constant is ug(x, y) = Ag/2. 

Finally, taking both sides of Equation 10.3.5 equal to —k?, 


X" +k?’ X =0, and | Y"—E?^yY — 0. (10.3.9) 
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The first of these equations, along with the boundary conditions X'(0) = X'(L) = 0, gives 
Xn(x) = cos(k,z), with kn = na/L, n = 1,2,3,.... The function Y, (y) for the same 
separation constant is 


Yn(y) = An cosh(k,y) + Bn sinh(kny). (10.3.10) 


We must take B,, = 0 because Y;(0) = 0. 

We now have the product solution X,,(x)Y,(y), which satisfies Laplace’s equation and 
all of the boundary conditions except Equation 10.3.2. By the principle of superposition, 
which we introduced in Section 8.3, the general solution is 


u(x, y) = ^ + 3 An eos (272) cosh (772) (10.3.11) 
n-i 


Applying this equation, we find that 


A = NTE nTz 
u(x, zo) = gzo + gex = e 4 > Án cos (27) cosh( L 2) ; (10.3.12) 


which we recognize as a Fourier half-range cosine series such that 


9 [L 
Ao = J (gzo + gcx) dz, (10.3.13) 
0 
and 
NT Zo aq NTT 
cosh ( L ) An = al (920 + gex) cos (777) dx. (10.3.14) 
Performing the integrations, 
Ao = 2gzo + gcL, (10.3.15) 
d 2gcL|1 1)" 
Ame ERE TE] (10.3.16) 


n?n? cosh(nmzo/ L)' 
Finally, the complete solution is 


oo 


gcL | 4AgcL cos[(2m — 1)ra/L] cosh|(2m — 1)ry/L] 
2 T? 2x (2m — 1)? cosh[(2m — 1)rzo/L] 


u(z,y) = gzo + (10.3.17) 


m=1 
Figure 10.3.2 presents two graphs by Toth for two different aquifers. We see that the 
solution satisfies the boundary condition at the bottom and side boundaries. Water flows 
from the elevated land (on the right) into the valley (on the left), from regions of high to 
low hydraulic potential. 


e Example 10.3.2 


In the previous example, we had the advantage of homogeneous boundary conditions 
along x = 0 and x = L. In a different hydraulic problem, Kirkham? solved the more difficult 
problem of 

u u 


512 72 70 O<a<L, 0<y<h, (10.3.18) 
T y 


3 Kirkham, D., 1958: Seepage of steady rainfall through soil into drains. Trans. Am. Geophys. Union, 
39, 892—908. 
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Figure 10.3.2: Two-dimensional potential distribution and flow patterns for different depths of the hori- 
zontally impermeable boundary. 


subject to the Dirichlet boundary conditions and 


0, 0<y<a, 
u(0,y) = | Be(y-a), a<y<b, (10.3.20) 
RL, b<y<h. 


This problem arises in finding the steady flow within an aquifer resulting from the intro- 
duction of water at the top due to a steady rainfall and its removal along the sides by 
drains. The parameter L equals half of the distance between the drains, h is the depth of 
the aquifer, and R is the rate of rainfall. 

The point of this example is: We need homogeneous boundary conditions along either 
the x or y boundaries for separation of variables to work. We achieve this by breaking the 
original problem into two parts, namely 


u(z,y) = v(x, y) + w(x, y) + RL, (10.3.21) 
where 9 9 
v vU 
92 ag Oczrz«L, 0<y<h, (10.3.22) 
with 
v(0,y) =v(L,y) 20, ^ v(z,h) — 0, (10.3.23) 
and 
v(z,0) = R(x — L); (10.3.24) 
Ow Fw 
"e — L h 10.3.2 
Oz? ^ Oy 0, O<a<b, O<y<h, (10.3.25) 
with 
w(z,0) = w(xz,h) = 0, w(L, y) ^ 0, (10.3.26) 
and 
—RL, 0«yc«a, 
w(0, y) = BL(y-a)- RL, a<y<b, (10.3.27) 
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Employing the same technique as in Example 10.3.1, we find that 


E = , (nme, sinh[nz(h — y)/L] 
nes 2 An sin( L ) sinh(nmh/L) ' Mosam 
where * 
2 . (mma 2RL 
Aog, Ble Ds (T7) de = - T cree 


Similarly, the solution to w(z, y) is found to be 


Ur) S B. sin(“™) m x un (10.3.30) 


where 
_2 9?» (mmy ^ (y—a . (NTY 
DB, = h E sin (= dy + rif (= =. 1) sin( 72) dy (10.3.31) 


DET | (57) sia (276) =}. (10.3.32) 


The complete solution consists of substituting Equation 10.3.28 and Equation 10.3.30 into 
Equation 10.3.21. 


e Example 10.3.3: Poisson's integral formula 


In this example we find the solution to Laplace’s equation within a unit disc. The 
problem can be posed as 

Pu | 1du d Pu 

0r? rOr mOg | 


0 O<r<l, 0<y<2z, (10.3.33) 


with the boundary condition u(1, p) = f(y). 
We begin by assuming the separable solution u(r, p) = R(r)®(y) so that 


r2 R" + rR! o" 


E. (10.3.34) 
R o 
The solution to ®” + k?$ = 0 is 
(y) = Acos(ky) + Bsin(ky). (10.3.35) 
The solution to R(r) is 
R(r) = Cr* + Dr^*. (10.3.36) 
Because the solution must be bounded for all r and periodic in y, we must take D = 0 and 
k =n, where n = 0,1,2,3,.... Then, the most general solution is 
u(r, p) = $ao + 5 [an cos(nq) + bn sin(ng)] r”, (10.3.37) 


n=1 
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where an and b, are chosen to satisfy 


u(1, e) = f(y) = $ao + 5 an cos(nq) + bn sin(ny). (10.3.38) 
n=1 
Because 
MAN lo : 
dn = — f(0)cos(n0) d0, bn = - | f (0) sin(n8) d0, (10.3.39) 


we may write u(r, p) as 


one ct if FO) E EY r” cos{n(6 — aj dd. (10.3.40) 


T 


If we let a = 0 — o, and z = r[cos(o)) + isin(a)], then 


2» Penna «(x J = x(: - -) = JP z IUE ir al (10:941) 


n=0 n=0 
1 — r cos(a) + ir sin(a) 
= 10.3.42 
nl 1 — 2r cos(a) + r? (10.3.42) 
for all r such that |r| < 1. Consequently, 
oo 1 = 
Y r” cos(na) = eG) : (10.3.43) 
= 1 — 2rcos(a) +r 
‘ee 1 — r cos(a) 1 
= ý = 10.3.44 
2 is P9. CES) 1 — 2rcos(a) +r? 2 ( ) 
E rus (10.3.45) 
-= 21 -2rcos(a) + r?' e 
Substituting Equation 10.3.45 into Equation 10.3.40, we finally have that 
Gey -f n» me dó (10.3.46) 
USO a -u l—2rcos(0— p) +r? ` ud 


This solution to Laplace's equation within the unit circle is referred to as Poisson’s integral 
formula.* 


4 Poisson, S. D., 1820: Mémoire sur la maniére d’exprimer les fonctions par des séries de quantités 


périodiques, et sur l'usage de cette transformation dans la résolution de différens problémes. J. Ecole 
Polytech., 18, 417—489. 
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Problems 


Solve Laplace's equation over the rectangular region 0 < x < a, 0 < y < b with the following 
boundary conditions. Illustrate your solution using MATLAB. 


1. u(z,0) = u(z, b) = u(a,y) = 0, u(0,y) 21 
2. u(x, 0) = u(0, y) = u(a, y) = 0, u(x, b) = a 


3. u(x, 0) = u(0, y) = ula, y) = 0, u(x, b) = £ — a 


4. u(z,0) = u(0, y) = u(a, y) = 0, 
= 2x/a, 0 « z « a/2, 
WEB) =| og Bia, a/2 « x « a. 


5. uy(z,0) = uy(a, b) = 0, u(0, y) = u(a,y) 21 


6. u,(z,0) = u(z, b) = 0, u(0,y) = u(a, y) = 1 Hint: Set u(x, y) = 1+ v(z, y). 


7. Ux(0,y) = 0, u(a, y) = u(x, 0) = u(z, b) = 1 Hint: Set u(x, y) = 1 + v(z, y). 


8. u(a,y) = u(z,b) = 0, u(0,y) = u(z,0) = 1 Hint: Set u(x, y 
v(0, y) = v(a, y) = v(x, b) = 0, v(x, 0) = 1 and w(z,0) = w(x, b) 


9. us (0, y) = us (a, y) = 0, u(x, b) = Uu; 


Jfa),  0€r«0, Hint: = 
TDI 0, bap. Hint: Set u(x, y) = u1 + v(x, y). 


D y) + w(x, y) with 


10. Variations in the earth’s surface temperature can arise as a result of topographic 
undulations and the altitude dependence of the atmospheric temperature. These variations, 
in turn, affect the temperature within the solid earth. To show this, solve Laplace’s equation 
with the surface boundary condition that 


u(x, 0) = To + AT cos(2rz/A), 


where À is the wavelength of the spatial temperature variation. What must be the condition 
on u(x, y) as we go towards the center of the earth (i.e., y > oo)? 


11. T6th° generalized his earlier analysis of groundwater in an aquifer when the water 
table follows the topography. Find the groundwater potential if it varies as u(x, zo) = 
g[2o + cz + asin(bx)] at the surface y = zo, while uz(0, y) = uz(L, y) = uy(x,0) = 0, where 
g is the acceleration due to gravity. Assume that bL Æ nz, where n = 1,2,3,.... 


12. During his study of fluid flow within a packed bed, Grossman? solved 


Pu Dhu 


ER mn O0<a<l, 0«yc«L, 


5 Tóth, J. A., 1963: A theoretical analysis of groundwater flow in small drainage basins. J. Geophys. 
Res., 68, 4795-4812. 


6 Grossman, G., 1975: Stresses and friction forces in moving packed beds. AICHE J., 21, 720-730. 
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subject to the boundary conditions u(z,0) = L, u(x, L) 2 0, 0 < x < 1, and u,(0,y) = 0, 
us(l,y) = —y,0 < y < L. What should he have found? Hint: Introduce u(z,y) = 
L-—y-wvv(z, y). 


Poissons Integral Formula 


13. Using the relationship 


2m 2 
| We eS ies 
o L—Dbdcos(y) 1— 0» 


and Poisson's integral formula, find the solution to Laplace's equation within a unit disc if 
u(1,q) = f(y) = To, a constant. 


10.4 POISSON’S EQUATION ON A RECTANGLE 


Poisson’s equation’ is Laplace’s equation with a source term: 


u u 
Age + Oy? = f(x,y). (10.4.1) 


It arises in such diverse areas as groundwater flow, electromagnetism, and potential theory. 
Let us solve it if u(0,y) = u(a, y) = u(x, 0) = u(x, b) = 0. 
We begin by solving a similar partial differential equation: 


Oru u 
oma 5 0«r«a, 0«yc«b, (10.4.2) 


by separation of variables. If u(x, y) = X(x)Y (y), then 


Xx" y" 


Y^ Y^ (10.4.3) 


Because we must satisfy the boundary conditions that X(0) = X(a) = Y (0) = Y (b) = 0, 
we have the following solutions: 


X,(z) = sin(“**) , Ya(z)- sin( 228) (10.4.4) 
a 
with A44, = —n?z?/a? — m?r?/b?; otherwise, we would only have trivial solutions. The 
corresponding particular solutions are 
iam = fan sin( 22) sin( 72) (10.4.5) 
a 


7 Poisson, S. D., 1813: Remarques sur une équation qui se présente dans la théorie des attractions des 
sphéroides. Nouv. Bull. Soc. Philomath. Paris, 3, 388—392. 
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Siméon-Denis Poisson (1781-1840) was a product as well as a member of the French scientific 
establishment of his day. Educated at the École Polytechnique, he devoted his life to teaching, both 
in the classroom and with administrative duties, and to scientific research. Poisson's equation dates 
from 1813 when Poisson sought to extend Laplace's work on gravitational attraction. 


courtesy of the Archives de l'Académie des sciences, Paris.) 


(Portrait 


where n = 1,2,3,..., and m = 1,2,3,.... 
For a fixed y, we can expand f(z, y) in the half-range Fourier sine series 


f(x,y) = 35 An(y) sin( 25 


where 


Anly) = =f re) sin(“*) dz. 


However, we can also expand A; (y) in a half-range Fourier sine series 
aa MTY 
Anly) = 2 Anm sin( 772) ; 


where 


(10.4.6) 


(10.4.7) 


(10.4.8) 


Qnm = ae Anly) sm( T) dy — E a f(xy) sin(“"*) sin( T) dz dy, 
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and "IT 
f(x,y) = 2.2. Arii sin(”7) sin( 28) , (10.4.10) 


In other words, we re-expressed f(x,y) in terms of a double Fourier series. 
Because Equation 10.4.2 must hold for each particular solution, 


unm Oum 


. [NTEN . (mm 
Ox? + y = AnmUnm = Qnm sin(““*) sin( 772) , (10.4.11) 


b 


if we now associate Equation 10.4.1 with Equation 10.4.2. Therefore, the solution to Pois- 
son's equation on a rectangle where the boundaries are held at zero is the double Fourier 
series 


u(zy)--».», CUI RN m sin(““*) sin( =) (10.4.12) 


n=1m=1 
Problems 
1. The equation 


0?u Pu R 
0x2 Oy2 — T" 


O0<a<a, 0<y<b, 


describes the hydraulic potential (elevation of the water table) u(x, y) within a rectangular 
island on which a recharging well is located at (a/2,b/2). Here R is the rate of recharging 
and T is the product of the hydraulic conductivity and aquifer thickness. If the water table 
is at sea level around the island so that u(0, y) = u(a, y) = u(z, 0) = u(z, b) = 0, find u(x, y) 
everywhere in the island. 


2. Solve 5 2 

A t opp = e inla), 0cr«m, 0<y<H, 
subject to the boundary conditions that (1) u(x, 0) = 0, u(x, H) = f(x) for 0 < x <7 and 
(2) u(0, y) = u(1, y) 2 0 fr 0< y « H. 


Step 1: Setting u(x, y) = v(z, y) + w(z, y), show that you can break the problem into two 
parts. The first part consists of solving the Laplace equation 


8v 8v 


J + g =o Ü0cr«m, 0<y<H, 


subject to the boundary conditions that (1) v(x, 0) = 0, v(x, H) = f(x) for 0 < x < m and 
(2) v(0, y) = v(7, y) = 0 for 0 < y < H. The second part involves solving 


Ow Aw 


Baz t my 76 eina) O<a<n, O«y«H, 


subject to the boundary conditions that (1) w(z,0) = w(x, H) = 0 for 0 < x < m and (2) 
w(0,y) = w(z,y) =0 for0<y< H. 
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Step 2: Use separation of variables, and show that 
v(z,y) = 5 An sinh(ny) sin(nx), 
n=1 


where 
sinh(nH)A -ifn f(x) sin(nz) 


Step 3: Assuming that w(x,y) = g(y)sin(z), show that g(y) is governed by the ordinary 
differential equation: 


g'(y)—-g(y) =e", X g(0)— g(H) = 0. 


Step 4: Using the method of undetermined coefficients, show that the solution to Step 3 is 


€?  sinh(y — H) — e°” sinh(y) 


gy) => + 3 sinh(H) 


Step 5: Show that the half-range Fourier sine expansion for e?" is 


2 3 n n 2H) n [PTY 
GEN Same [1 — (-1)"e J sm( 772), 0<y< H. 
n=1 


Step 6: Using the results from Step 5 and assuming that 


oo 
nmm 
- Y BT), 0<y<H, 
n=1 
show that an alternative expression for w(z.y) is 


«(e = ane) E. pe GN 


«(9 
SIN . 
(n2z2 + H?)(n?z? + AH?) H 


The figure labeled Problem 2 illustrates v(x, y) when H = 2. 


3. Solve 
3u n Pu 
Ox? Oy? — 
subject to the boundary conditions that (1) u(z,0) = 0, lim, 55 |u(z, y)| < oo for0 < x < 1, 
and (2) u(0, y) = 0, u(1,y) = 1 for 0 < y < oc. 


—h, O0<a<l, 0<y< œ, 


Step 1: Setting u(x, y) = x--hx(1—2)/2— v(z, y), show that the problem reduces to solving 
Laplace's equation: 


Ov Ov 


ae Oe O0<a<l, 0«ygyc«oo, 
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Problem 2 Problem 3 


gs 


subject to the boundary conditions that (1) v(0, y) = v(1, y) = 0 for 0 < y < oo, and 


v(z,0) = xz + hz(1— z)/2, lim |v(z, y)| < oo, 0 « x « 1. 
yoo 


Step 2: Use separation of variables, and show that 


2 (-1)n*1 2h [1 — (-1)" 
v(z, y) = - 5 ( ) exp(—nzy) sin(nzz) + 3 | - "I exp(—nzy) sin(nzz). 
n=1 n=1 


The figure labeled Problem 3 illustrates u(x, y) when h = 10. 
10.5 NUMERICAL SOLUTION OF LAPLACE’S EQUATION 


In addition to the separation of variables, linear Laplace equations can be solved using 
conformal mapping or transform methods (see Section 6.7). However, when these analytics 
techniques fail us or we have a domain that is rather irregular in shape or we have a 
nonlinear equation, we must resort to numerical techniques. This section develops the 
popular numerical method of successive relaxation. 

The numerical analysis of an elliptic partial differential equation begins by replacing the 
continuous partial derivatives by finite-difference formulas. Employing centered differencing, 


Oru Um+1,n — Zum, n + Um-1,n ; 2 
A - 6. - O((Azy!], (10.5.1) 


and 


Ou una -2u T Um.n—1 
= cM LM Ay)? 10.5.2 
a (ADS + O(Ay, (10.5.2) 
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where Um,» denotes the solution value at the grid point m,n. If Ax = Ay, Laplace's 
equation becomes the difference equation 


Um--1,n + Um-—1,n 5E Um,n+1 + Um,n—1 — An n = 0. (10.5.3) 


Thus, we must now solve a set of simultaneous linear equations that yield the value of the 
solution at each grid point. 

The solution of Equation 10.5.3 is best done using techniques developed by algebraists. 
A very popular method for directly solving systems of linear equations is Gaussian elim- 
ination. However, for many grids at a reasonable resolution, the number of equations is 
generally in the tens of thousands. Because most of the coefficients in the equations are 
zero, Gaussian elimination is unsuitable, both from the point of view of computational 
expense and accuracy. For this reason alternative methods have been developed that gen- 
erally use successive corrections or iterations. The most common of these point iterative 
methods are the Jacobi method, unextrapolated Liebmann or Gauss-Seidel method, and 
extrapolated Liebmann or successive over-relaxation (SOR). None of these approaches is 
completely satisfactory because of questions involving convergence and efficiency. Because 
of its simplicity we will focus on the Gauss-Seidel method. 

We may illustrate the Gauss-Seidel method by considering the system: 


10x +y +z = 39, (10.5.4) 
2x + 10y +z — 51, (10.5.5) 

and 
2x + 2y + 10z = 64. (10.5.6) 


An important aspect of this system is the dominance of the coefficient of x in the first 
equation of the set and that the coefficients of y and z are dominant in the second and third 
equations, respectively. 

'The Gauss-Seidel method may be outlined as follows: 


e Assign an initial value for each unknown variable. If possible, make a good first guess. 
If not, any arbitrarily selected values may be chosen. The initial value will not affect the 
convergence but will affect the number of iterations until convergence. 


e Starting with Equation 10.5.4, solve that equation for a new value of the unknown which 
has the largest coefficient in that equation, using the assumed values for the other unknowns. 


e Go to Equation 10.5.5 and employ the same technique used in the previous step to compute 
the unknown that has the largest coefficient in that equation. Where possible, use the latest 
values. 


e Proceed to the remaining equations, always solving for the unknown having the largest 
coefficient in the particular equation and always using the most recently calculated values 
for the other unknowns in the equation. When the last equation, Equation 10.5.6, has been 
solved, you have completed a single iteration. 


e Iterate until the value of each unknown does not change within a predetermined value. 
Usually a compromise must be struck between the accuracy of the solution and the desired 


rate of convergence. The more accurate the solution is, the longer it will take for the solution 
to converge. 
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'To illustrate this method, let us solve our system, Equation 10.5.4 through Equation 
10.5.6, with the initial guess x = y = z = 0. The first iteration yields x = 3.9, y = 4.32, 
and z = 4.756. The second iteration yields z = 2.9924, y = 4.02592, and z = 4.996336. As 
can be readily seen, the solution is converging to the correct solution of x = 3, y = 4, and 
z=6. 

Applying these techniques to Equation 10.5.3, 


k+1 _ 1 k k+1 k k+1 
Um,n TA an + Um—1,n + Um,n+1 + ust) , (10.5.7) 


where we assume that the calculations occur in order of increasing m and n. 
e Example 10.5.1 


'To illustrate the numerical solution of Laplace's equation, let us redo Example 10.3.1 
with the boundary condition along y = H simplified to u(x, H) = 1 + x/L. 

We begin by finite-differencing the boundary conditions. The condition u,(0,y) = 
us(L,y) = 0 leads to u1,, = u-1, and UM+1,n = uu 1,5 if we employ centered differences 
at m — 0 and m — M. Substituting these values in Equation 10.5.7, we have the following 
equations for the left and right boundaries: 


k k 
up. = i (2uf n + uË n41 F ugha) (10.5.8) 
and 
k+1 k+1 k+1 
Du = n Z oT T UM nl nd ara) : (10.5.9) 


On the other hand, u,(z,0) = 0 yields um,ı = Um,—1, and 
k 
— ī (utri + umo + Que 1) : (10.5.10) 


At the bottom corners, Equation 10.5.8 through Equation 10.5.10 simplify to 


ups = 3 (ufo ui) (10.5.11) 
and 
DA -5 (urs us ub) . (10.5.12) 


'These equations along with Equation 10.5.7 were solved with the Gauss-Seidel method 
using the MATLAB script: 


clear 
dx = 0.1; x = O:dx:1; 


M = 1/dx+1; % M = number of x grid points 
dy = 0.1; y = O:dy:1; N = 1/dy+1; % N = number of y grid points 
x? * ones(1,N); Y = ones(M,1) * y; 
zeros(M,N); ^ create initial guess for the solution 
^4 introduce boundary condition along y = H 
for m = 1:M; u(m,N) = 1 + x(m); end 
^4 start Gauss-Seidel method for Laplace’s equation 
for iter = 1:256 
^ do the interior first 
for n = 2:N-1; for m = 2:M-1; 
u(m,n) = (u(mti,n)+u(m-1,n)+u(m,nt1)+u(m,n-1)) / 4; 


E ps 
"oul 
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end; end 
^ now do the x = O and x = L sides 
for n = 2:N-1 
u(1,n) = (2xu( 2 ,n)*u(1,n*1)*u(1,n-1)) / 4; 
u(M,n) = (2xu(M-1,n)*u(M,n*1)*u(M,n-1)) / 4; 
end 
^ now do the y = 0 side 
for m = 2:M-1 
u(m,1) = (u(mt+1,1)+u(m-1,1)+2*u(m,2)) / 4; 
end 
% finally do the corners 
u(1,1) = (u(2,1)4+u(1,2))/2; u(M,1) = (u(M-1,1)+u(M,2))/2; 
% plot the solution 
if (iter == 4) subplot(2,2,1), [cs,h] = contourf(X,Y,u); 
clabel(cs,h,[0.2 0.6 1 1.4],’Fontsize’ ,16) 
axis tight; title( after 4 iterations’, ’Fontsize’ ,20); 
ylabel(’Y/H’,’Fontsize’ ,20); end 
if (iter == 16) subplot(2,2,2), [cs,h] = contourf(X,Y,u); 
clabel(cs,h,’Fontsize’ ,16) 
axis tight; title(’after 16 iterations’, ’Fontsize’ ,20); 
ylabel(’Y/H’,’Fontsize’ ,20); end 
if (iter == 64) subplot(2,2,3), [cs,h] = contourf(X,Y,u); 
clabel(cs,h,’Fontsize’ ,16) 
axis tight; title(’after 64 iterations’, ’Fontsize’ ,20); 
xlabel(’X/L’,’Fontsize’ ,20); ylabel(’Y/H’, ’Fontsize’ ,20); 
end 
if (iter == 256) subplot(2,2,4), [cs,h] = contourf(X,Y,u); 
clabel(cs,h,"Fontsize',16) 
axis tight; title(’after 256 iterations? ,"Fontsize?,20); 
xlabel(C X/L?,?Fontsize?,20); ylabel(’Y/H’,’Fontsize’ ,20) ; 
end 
end 


The initial guess everywhere except along the top boundary was zero. In Figure 10.5.1 
we illustrate the numerical solution after 4, 16, 64, and 256 iterations, where we have taken 
11 grid points in the x and y directions. 


Project: Successive Over-Relaxation 


The fundamental difficulty with relaxation methods used in solving Laplace’s equation 
is the rate of convergence. Assuming Az = Ay, the most popular method for accelerating 
convergence of these techniques is successive over-relaxation (SOR): 


ura = (L—w)uk, +wRm,n, 


m,n 


where 


= k k+1 k k+1 
Rm,n m A (ukin T Um 1m + Um,n+1 T uoa) i 
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after 4 iterations i after 16 iterations 


0 0.5 1 0 0.5 1 
after 64 iterations i after 256 iterations 


0 0.5 1 0 0.5 1 
X/L X/L 


Figure 10.5.1: The solution to Laplace’s equation by the Gauss-Seidel method. The boundary conditions 
are uz(0, y) = uz(L, y) = uy(z, 0) = 0, and u(z, H) = 1 + z/L. 


Most numerical methods books dealing with partial differential equations discuss the theo- 
retical reasons behind this technique; the optimum value always lies between one and two. 
In the present case, a theoretical analysis? gives 


4 
Wopt = 24 acp 
where - e 
c= cos( £) + cos( 7) ; 
and N and M are the number of mesh divisions on each side of the rectangular domain. 
Recently Yang and Gobbert!? generalized the analysis and found the optimal relaxation pa- 


rameter for the successive-overrelaxation method when it is applied to the Poisson equation 
in any space dimensions. 


Step 1: Write a MATLAB script that uses the Gauss-Seidel method to numerically solve 
Laplace’s equation for 0 € x < L, O < y € zo with the following boundary conditions: 
u(z,0) = 0, u(x, zo) = 1 + 2/L, u(0, y) = y/zo, and u(L,y) = 2y/zo. Because this solution 
will act as "truth" in this project, you should iterate until the solution does not change. 


8 For example, Young, D. M., 1971: Iterative Solution of Large Linear Systems. Academic Press, 570 
Pp. 


9 Yang, S., and M. K. Gobbert, 2009: The optimal relaxation parameter for the SOR method applied 
to the Poisson equation in any space dimensions. Appl. Math. Letters, 22, 325-331. 


10 Tbid. 
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1000 


number of iterations 
9 
o 


Figure 10.5.2: The number of iterations required so that |Rmjn| < 10-? as a function of w during the 
iterative solution of the problem posed in the project. We used Az = Ay = 0.01, and L = zo = 1. The 
iteration count for the boundary conditions stated in Step 1 is given by the solid line while the iteration 
count for the boundary conditions given in Step 2 is shown by the dotted line. The initial guess equaled 
zero. 


Step 2: Now redo the calculation using successive over-relaxation. Count the number of 
iterations until |Rm,n| < 107? for all m and n. Plot the number of iterations as a function 
of w. How does the curve change with resolution Az? How does your answer compare to 
the theoretical value? See Figure 10.5.2. 


Step 3: Redo Steps 1 and 2 with the exception of u(0,y) = u(L,y) = 0. How has the 
convergence rate changed? Can you explain why? How sensitive are your results to the 
first guess? 


Project: Finite Difference Solution of Poisson's Equation 


'The analytic solution of Laplace's and Poisson's equations are often not available and 
we must resort to numerical approximation. In this project you will use finite differences 
to solve the Poisson equation: 

u Ou 

ag t ap €?! sin(x), O<a<m, 0«yc«m, (10.5.13) 
subject to the boundary conditions that u(z,0) = u(x,t) = 0 for 0 < x < « and u(0, y) = 
w(a,y) = 0 for 0 < y < r. The exact solution is 


e?"  sinh(y— 7) — €?" sinh(y) 
3 3 sinh(z) 


u(x, y) = sin(x) (10.5.14) 


This project requires a knowledge of matrix algebra (see Sections 3.1 and 3.4). 


Step 1: If we introduce nodal points at 2, = mh and yn = nh, where m —0,1,2,..., M +1, 
n —0,1,2,..., N + 1, and h = Ax = Ay = 7/(M +1). Using centered finite differencing, 
show that the partial differential equation can be approximated by 


1 -1 1 —1 wai 
until tue Hunt + ut) buh = he sine), n=1,2,..., N, m=1,2,..., M. 
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= 
c 
3 


y/T 


Figure 10.5.3: The numerical solution to Equation 10.5.13. Here N = M = 29 so that h = 7/30. The 
largest relative error is 0.175. 


! 
ult! — 0. 


n n 0 
Here uj = uy, = Um 


Step 2: We now want to cast Step 1 as the linear algebra problem Au = f. As a first step, 
let us choose N = M = 3 and h = 7/4. This is a very crude approximation but we will soon 
increase the value of N and M. Show that this simple case yields 9 simultaneous equations 
which can be written in matrix form as 


—4 1 0 1 0 0 0 0 0 ui h? fl — uj — ud 
1 -4 1 0 1 0 O0 O0 0 ui h? f2 — ua 
0 1 -4 1 0 1 0 O0 O0 ul h? f? — ug — ut 
1 0 1 -4 1 0 1 0 0 ul h? få — ul 
0 1 0 1 -4 1 0 1 0 uz | = | Pr 
0 0 1 0 1 -4 1 0 1 u3 k f3 — us 
0 0 0 1 0 1 -4 1 0 us h? fi — ul — «8 
0 0 0 O0 1 O0 1 -4 1 dis hp ay 
0 0 0 O0 0 1 O0 1] -4 us h? f3 — u3 — u$ 
In the present case, u? = u? = u, = uf, = 0; in general, this will not be the case. 


Step 3: Using MABLAB, solve for uf, for m = 1,2,3 and n = 1,2,3. Find that grid point 
which has the largest relative error |unumericai (4, Y) — Wezact(t, y)| between the numerical 
and exact solutions. 


Step 4: Now generalize your code to treat the general case and find the numerical solution 
to Poisson's equation. For a particular value of M, N, find the grid point which has the 
largest value of relative error. 


Because the matrix A is a sparse matrix (most of its elements equal zero) this direct method 
for finding numerical solutions to Poisson's equation was rarely used because of its com- 
putational expense. However, with the advent of power of computational engines such as 
MATLAB this method is becoming competitive with other, more complicated methods. 
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Project: Mixed Boundary-Value Problems 


In this chapter we focused on solving Laplace's equation when we have a Dirichlet 
or Neumann boundary condition. For example, u(0,y) = u(z,y) = 0. In Chapter 11 we 
will expand our knowledge by considering problems where we have one type of boundary 
condition along one boundary [for example, the Neumann condition u,(0,y) = 0] and 
another type of boundary condition along another boundary [for example, the Dirichlet 
condition u(r, y) = 0]. Some call this situation a mixed boundary-value problem; we will 
not. 

In this project we consider the case where we have one type of boundary condition along 
some portion of a boundary and another type along other parts of the same boundary. A 
simple example of a mixed boundary-value problem is 


u u 
asta Deum «ye, (10.5.15) 


subject to the boundary conditions that 


u(x,0) — 1, 0<a2r<e, : 
eee, =i) ee jm, u(x, y) — 0, 0<a<n, (10.5.16) 
and 
us (0, y) = u(t, y) = 0, 0«gy«oo, (10.5.17) 


where 0 < c < m. Solving this challenging problem will require a knowledge of matrix 
algebra (see Sections 3.1 and 3.4). 


Step 1: We begin as usual by using separation of variables. Show that 


u(x, y) = Y QUE 3v] cos[(n — 4) a] (10.5.18) 


solves Laplace’s equation and the boundary conditions except along y = 0. 


Step 2: Show that our solution must satisfy the dual conditions: 


5 An cos[(n—4)z]=1, O<2<ce, (10.5.19) 
n=1 ee, 2 
and " 
ys An cos|(n — 5) «| = 0, c«m«m. (10.5.20) 
n=l 


This is similar to other separation of variables problems where our final task was to deter- 
mine the Fourier coefficients of a half-range expansion, except that we now have two series!! 


Step 3: There is actually a closed form solution to this dual Fourier series Equation 10.5.19 
and 10.5.20: 
P, 4[cos(c)] 


4^ = Kicos (ef): 
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Figure 10.5.4: The numerical solution to the mixed boundary-value problem Equations 10.5.15 through 
10.5.17. Here c = 7/2. 


where P,,(-) is the Legendre polynomial of order n (see Section 12.1) and K(-) is a complete 
elliptic integral of the first kind. The derivation of this result is beyond the scope of this 
book.! 

What would we have done if this result did not exist? Let us replace the conditions 
Equations 10.5.19 and 10.5.20 with 


and 
XC An cos[(n - 4) z:] = 0, c«a«m, 


where x; = (i — 1)r/N and i = 1,2,3,..., N. This results in a system of N x N linear 
simultaneous equations. 


Step 4: Using MATLAB, solve for the N values of A, in Step 3. As a function of c, compare 
these values of An with the ones for N = oo. Employing these new A,,’s, compute u(x, y). 
Does it satisfy the boundary conditions? 


Step 5: Let's attack this problem using centered finite differencing. Using the relaxation 
method, write down a scheme to solve our problem. This problem poses several interesting 


11 See Duffy, D. G., 2008: Mixed Boundary Value Problems. Chapman & Hall/CRC, Example 3.1.1. 
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challenges. First, how do we deal with the fact that y extends from 0 to oo? Second, how 
do we compute the solution for c < x < m along y = 0 and for 0 < y < oo for x = 0? 


Step 6: Compute the solution using relaxation and compare it with the solution that you 
found in Step 4. 
Further Readings 


Koshlyakov, N. S., M. M. Smirnov, and E. B. Gliner, 1964: Differential Equations of Math- 
ematical Physics. North-Holland Publishing, 701 pp. See Part II. Detailed presentation of 
mathematical techniques. 


Morse, P. M., and H. Feshback, 1953: Methods of Theoretical Physics. McGraw-Hill Book 
Co., 997 pp. Chapter 10 is devoted to solving both Laplace's and Poisson's equations. 


4.0 


3.0 


2.0 


0.0 


Chapter 11 
The Sturm-Liouville Problem 


In Chapters 1, 2, and 7 we solved ordinary differential equations where some quantity 
evolves in time from some initial condition. Although these initial-value problems are im- 
portant in engineering and the physical sciences, they are not the only special class of 
problems involving differential equations. 

In the three previous chapters we solved linear partial differential equations using the 
technique commonly called “separation of variables." Assuming that the solution could 
be written u(x,t) = X(x)T(t) or u(z,y) = X(z)Y (y), we solved the ordinary differential 
equation 

X" -- AX — 0, O0<a<L, 0«A, (11.0.1) 
with the boundary conditions X(0) = X(L) = 0 or X'(0) = X'(L) = 0. This is an 
example of a boundary-value problem because the solution must satisfy boundary conditions 
at the end points rather than a single initial condition. Furthermore, unlike initial-value 


problems, the present boundary-value problem has an infinite number of possible solutions. 
For example, if X(0) = X(L) = 0, then we have 


X4(r) =sin(nrz/L), with An —m?m?/L? and n=1,2,3,.... (11.0.2) 


Prefiguring the material in this chapter, the A;,'s are called the eigenvalues and the X,,(x)’s 
are the corresponding eigenfunctions of this Sturm-Liouville boundary-value problem. 

In this chapter we expand our ability to solve boundary-value problems. For example, 
we would like to solve the boundary-value problem 


X" E AX — 0, uae, (11.0.3) 


with X(0) = X'(L) = 0 and à > 0. The eigenfunctions for this problem will be shown to 
be X,(x) = sin[(2n — 1)1z/2] with a corresponding eigenvalue of A, = (2n — 1)?z?/4. 
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This is not the first time that we have encountered the eigenvalue problem. In Section 
3.5 we studied eigenvalues and eigenvectors in our solution of systems of ordinary differential 
equations. Indeed, had we used finite-difference techniques to solve the heat equation (for 
example), we would have obtained a system of ordinary differential equations and the eigen- 
vectors would be the discrete approximation of the corresponding continuous eigenfunctions 
that would arise during the separation of variable solution. 

Finally, just as we used half-range Fourier sine and cosine expansions to solve partial 
differential equations, we will construct linear sums of eigenfunctions from Sturm-Liouville 
problems to re-express a piece-wise continuous function f(x). These eigenfunction expan- 
sions, in turn, will be used in solving linear partial differential equations. 


11.1 EIGENVALUES AND EIGENFUNCTIONS 


Repeatedly, in the next three chapters on partial differential equations, we will solve 
the following second-order linear differential equation: 


‘ Ld + [g(z)--Ar(r)y—-0, amb, (11.1.1) 


together with the boundary conditions: 


ay(a) + By'(a) 2-0 and . «y(b)-- ôy (b) — 0. (11.1.2) 


In Equation 11.1.1, p(x), q(x), and r(x) are real functions of x; A is a parameter; and 
p(x) and r(x) are functions that are continuous and positive on the interval a < x < b. 
Taken together, Equation 11.1.1 and Equation 11.1.2 constitute a regular Sturm-Liouville 
problem, named after the French mathematicians Sturm and Liouville! who first studied 
these equations in the 1830s. In the case when p(x) or r(x) vanishes at one of the endpoints 
of the interval [a,b] or when the interval is of infinite length, the problem becomes a singular 
Sturm-Liowville problem. 

Consider now the solutions to the regular Sturm-Liouville problem. Clearly there is the 
trivial solution y = 0 for all A. However, nontrivial solutions exist only if À takes on specific 
values; these values are called characteristic values or eigenvalues. The corresponding 
nontrivial solutions are called the characteristic functions or eigenfunctions; trivial solutions 
are not eigenfunctions by definition. In particular, we have the following theorems. 


Theorem: For a regular Sturm-Liouville problem with p(x) > 0, all of the eigenvalues are 
real if p(x), q(x), and r(x) are real functions and the eigenfunctions are differentiable and 
continuous. 


1 For the complete history as well as the relevant papers, see Lützen, J., 1984: Sturm and Liouville’s 
work on ordinary linear differential equations. The emergence of Sturm-Liouville theory. Arch. Hist. Exact 
Sci., 29, 309-376. 
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fj 


By the time that Charles-François Sturm (1803-1855) met Joseph Liouville in the early 1830s, he 
had already gained fame for his work on the compression of fluids and his celebrated theorem on the 
number of real roots of a polynomial. An eminent teacher, Sturm spent most of his career teaching 
at various Parisian colleges. (Portrait courtesy of the Archives de l'Académie des sciences, Paris.) 


Proof: Let y(x) = u(x) + iv(z) be an eigenfunction corresponding to an eigenvalue À = 
Ar + 4A;, where àr, A; are real numbers and u(x), v(x) are real functions of x. Substituting 
into the Sturm-Liouville equation yields 


{p(a)[u’ (x) + iv'(z)]) + [q(x) + (Ar + àA;)r(x)][u(z) + iv(z)] = 0. (11.1.3) 
Separating the real and imaginary parts gives 
ip (zu Ga) + (a(x) + Alula) — Aar(w)o(w) = 0, (11.1.4) 


and 


[p(a)v' (£) + [q(x) + Ae ]o(c) + Air (x)u(x) = 0. (11.1.5) 


If we multiply Equation 11.1.4 by v and Equation 11.1.5 by u and subtract the results, we 
find that 


u(z)[p(z)v'(z)] — v(z)[p(z)u' (a) + Aem(z)[u? (x) + v?(x)] = 0. (11.1.6) 
The derivative terms in Equation 11.1.6 can be rewritten so that it becomes 


© fpe (a) ula) ~ plej (w))o(a)} + Aer) u(x) + vn) = 0. (11.1.7) 
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Although educated as an engineer, Joseph Liouville (1809-1882) would devote his life to teaching 
pure and applied mathematics in the leading Parisian institutions of higher education. Today he 
is most famous for founding and editing for almost 40 years the Journal de Liouville. (Portrait 


courtesy of the Archives de l'Académie des sci 


ences, Paris.) 


Integrating from a to b, we find that 


b 
-x f r(x)[u? (x) + v (z)] dx = (p(x)[u(z)v' (x) — v(z)u' a 


b 


From the boundary conditions, Equation 11.1.2, 


a[u(a) + iv(a)] 4 


and 


- B[w (a) + iv'(a)] = 0, 


yu(b) + iv(b)] 4 


- ó[u (b) + iv'(b)] = 0. 


Separating the real and imaginary parts yields 


au(a) + Bu' (a) = 0, 


and 
yu(b) + óu' (b) = 0, 


and av(a) + Bv'(a) = 0, 


and yu(b) + óv'(b) = 0. 


(11.1.8) 


(11.1.9) 


(11.1.10) 


(11.1.11) 


(11.1.12) 


Both a and 8 cannot be zero; otherwise, there would be no boundary condition at x = a. 


Similar considerations hold for y and 6. T 


herefore, 


u(a)v' (a) — u(a)u(a) 2 0, and u(b)v'(b) — u'(b)v(b) = 0, 


(11.1.13) 
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if we treat a, 6, y, and 6 as unknowns in a system of homogeneous equations, Equation 
11.1.11 and Equation 11.1.12, and require that the corresponding determinants equal zero. 
Applying Equation 11.1.13 to the right side of Equation 11.1.8, we obtain 


b 
ri | raver Ge)? oda =: (11.1.14) 


Because r(x) > 0, the integral is positive and A; = 0. Since A; = 0, A is purely real. This 
implies that the eigenvalues are real. 


If there is only one independent eigenfunction for each eigenvalue, that eigenvalue is 
simple. When more than one eigenfunction belongs to a single eigenvalue, the problem is 
degenerate. 


Theorem: The regular Sturm-Liouville problem has infinitely many real and simple eigen- 
values An, n = 0,1,2,..., which can be arranged in a monotonically increasing sequence 
ào < M1 € AQ < +++ such that iMn Àn = oo. Every eigenfunction yn(x) associated 
with the corresponding eigenvalue A, has exactly n zeros in the interval (a,b). For each 
eigenvalue there exists only one eigenfunction (up to a multiplicative constant). 


The proof is beyond the scope of this book but may be found in more advanced treatises.” 


In the following examples we illustrate how to find these real eigenvalues and their 
corresponding eigenfunctions. 


e Example 11.1.1 
Let us find the eigenvalues and eigenfunctions of 
y" + Ay — 0, (11.1.15) 
subject to the boundary conditions 
y(0) — 0, and y(m) — y(t) = 0. (11.1.16) 


Our first task is to check to see whether the problem is indeed a regular Sturm-Liouville 
problem. A comparison between Equation 11.1.1 and Equation 11.1.15 shows that they are 
the same if p(x) = 1, q(x) = 0, and r(x) = 1. Similarly, the boundary conditions, Equation 
11.1.16, are identical to Equation 11.1.2 if a = y = 1, ô = —1,8—0,a—0, and b = m. 

Because the form of the solution to Equation 11.1.15 depends on A, we consider three 
cases: \ negative, positive, or equal to zero. The general solution? of the differential equation 
is 


y(x) = Acosh(mz) + Bsinh(mz), if A«90, (11.1.17) 


2 See, for example, Birkhoff, G., and G.-C. Rota, 1989: Ordinary Differential Equations. John Wiley & 
Sons, Chapters 10 and 11; Sagan, H., 1961: Boundary and Eigenvalue Problems in Mathematical Physics. 
John Wiley & Sons, Chapter 5. 


3 In many differential equations courses, the solution to y” — m?y = 0, m > 0 is written y(x) = cie"? + 
c2e ""*. However, we can rewrite this solution as y(x) = (c1--c2) i (e? +e—™*)+(c1—c2) i (e? —e 
A cosh(mz) + Bsinh(mz), where cosh(mz) = (e"'* + e7™*)/2 and sinh(mz) = (e™* — e~™*)/2. The 
advantage of using these hyperbolic functions over exponentials is the simplification that occurs when we 
substitute the hyperbolic functions into the boundary conditions. 


mus da 
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X 
Figure 11.1.1: Graphical solution of tan(zx) = x. The roots of tan(kr) = k occur where the two lines 
intersect. 


y(x)-—C-Dz, if A-0, (11.1.18) 

and 
y(x) = Ecos(kx)+Fsin(kz), if A0, (11.1.19) 
where for convenience A = —m? < 0 in Equation 11.1.17 and \ = k? > 0 in Equation 


11.1.19. Both k and m are real and positive by these definitions. 
Turning to the condition that y(0) = 0, we find that A = C = E = 0. The other 
boundary condition y(r) — y(r) = 0 gives 


B[sinh(mz) — m cosh(m)] = 0, (11.1.20) 
D — 0, (11.1.21) 

and 
F[sin(kr) — kcos(kz)] = 0. (11.1.22) 


Let us turn to Equation 11.1.20 first. For nontrivial solutions to exist, B # 0. This 
occurs only if sinh(mz) — m cosh(mz) = 0. Solving this equation numerically (see the next 
example), we find that m—ı = 0.99618173, yielding A_; = —0.992378039. I have used a 
negative index to remind ourselves that A « 0. 

Next, consider Equation 11.1.21. This clearly shows that there are only trivial solutions 
for A = 0. 

Finally, Equation 11.1.22 yields nontrivial solutions only if tan(kz) = k. We can find 
these roots either numerically (see the next example) or graphically. Figure 11.1.1 illustrates 
the graphical method. 

Let us now find the corresponding eigenfunctions. There are two classes: For A < 0, we 
have y-1(z) = sinh(m_,a). On the other hand, for A > 0 we have that y,(x) = sin(k,z), 
where kn is the nth root of tan(kz) = k. Figure 11.1.2 illustrates the first four eigenfunctions 
from this second class of eigenfunctions. Traditionally, eigenfunction solutions are written 
without their arbitrary amplitude constant. 


e Example 11.1.2: Numerical computation of the eigenvalues 


In the previous example we showed how you could use graphical methods to find k, 
and the corresponding eigenvalue An. With the advent of powerful computational engines 
such as MATLAB, no one uses graphical methods anymore; rather we now use numerical 
methods. For example, using the Newton-Raphson method, we can find m. , via 


mE? m) — fmm] — 62052, URN 
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1.5 k= 1.29011 L ky = 2.37305 


k 3= 3.40918 L k 4= 4.42032 
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Figure 11.1.2: The first four eigenfunctions sin(kna) corresponding to the case of An = k2 > 0. 


where f(m) = sinh(mz) — mcosh(mz), and f'(m) = (x — 1) cosh(mm) — m sinh(mz). 


Similarly, to compute kn, we can use the algorithm: 


KEY = KO — ROY FRO],  i-012..., 


(11.1.24) 


where f(k) = sin(kx) — kcos(kz), and f'(k) = (v — 1) cos(kr) + kr sin(kz). Table 11.1.1 
illustrates this calculation and shows that after two iterations the answer is accurate enough 


for most applications. The first guess equals m) and BO, 


e Example 11.1.3 


For our second example, let us solve the Sturm-Liouville problem,* 


y" +Ay = 0, 
with the boundary conditions 
y(0) — y//(0) =0, and y(v)-— y'(v) = 0. 
Once again the three possible solutions to Equation 11.1.25 are 
y(x) = Acosh(ma) + Bsinh(mz), if A-—-—m? <0, 


y(x)—-C-Dz, if A-0, 


and 
y(x) = Ecos(kz)-- Fsin(kz), if A=k°>0. 


(11.1.25) 


(11.1.26) 


(11.1.27) 


(11.1.28) 


(11.1.29) 


^ Sosov and Theodosiou [Sosov, Y., and C. E. Theodosiou, 2002: On the complete solution of the 


Sturm-Liouville problem (d? X/dz?) + A? X = 0 over a closed interval. J. Math. Phys. (Woodbury, NY), 
43, 2831-2843] have analyzed this problem with the general boundary conditions, Equation 11.1.2. 
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Table 11.1.1: The Eigenvalues for the Problem Stated in Example 11.1.1 Found Using 


the Newton-Raphson Method. Here A., = —m2, and A, = k2 for n = 1,2,...,10. The 

Boldface Digits Are Those that Differ from the Exact Answer. 
m) or RO) m) Or KD m?) or k2 exact 

mı 1.00000000 0.99622790 0.99618174 0.99618173 

kı 1.50000000 1.28779341 1.29011264 1.29010965 

k2 2.50000000 2.37267605 2.37305303 2.37305297 

k3 3.50000000 3.40905432 3.40917905 3.40917905 

k4 4.50000000 4.42926447 4.42932070 4.42932070 

ks 5.50000000 5.44212548 5.44215560 5.44215560 

kg 6.50000000 6.45102925 6.45104726 6.45104726 

k7 7.50000000 7.45755868 7.45757031 7.45757031 

kg 8.50000000 8.46255178 8.462559 72 8.46255972 

kg 9.50000000 9.46649370 9.46649936 9.46649936 

ki 10.50000000 10.46968477 10.46968896 10.46968896 


Let us first check and see if there are any nontrivial solutions for A < 0. Two simulta- 
neous equations result from the substitution of Equation 11.1.27 into Equation 11.1.26: 


A— mB - 0, (11.1.30) 
and 
[cosh(mz) — m sinh(m7)]|A + [sinh(mz) — m cosh(mz)]B = 0. (11.1.31) 
The elimination of A between the two equations yields 
sinh(mz)(1 — m?)B = 0. (11.1.32) 
If Equation 11.1.27 is a nontrivial solution, then B 4 0, and 
sinh(m7) = 0, or ni 2d. (11.1.33) 


The condition sinh(mz) = 0 cannot hold because it implies m = A = 0, which contradicts 
the assumption used in deriving Equation 11.1.27 that A < 0. On the other hand, m? = 1 
is quite acceptable. It corresponds to the eigenvalue A = —1 and the eigenfunction is 


yo = cosh(x) + sinh(z) = e”, (11.1.34) 
because it satisfies the differential equation 
Yo — yo = 9, (11.1.35) 
and the boundary conditions 


yo(0) — yo(0)=0, ^ and (11.1.36) 
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An alternative method of finding m, which is quite popular because of its use in more 
difficult problems, follows from viewing Equation 11.1.30 and Equation 11.1.31 as a system 
of homogeneous linear equations, where A and B are the unknowns. It is well known? that 
for Equation 11.1.30 and Equation 11.1.31 to have a nontrivial solution (i.e., A Æ 0 and/or 
B #0) the determinant of the coefficients must vanish: 


1 —m 
cosh(mm) — msinh(mz)  sinh(mm) — mcosh(m) | | 0 HIS) 
Expanding the determinant, 

sinh(mz)(1 — m?) = 0, (11.1.38) 


which leads directly to Equation 11.1.33. 
We consider next the case of A = 0. Substituting Equation 11.1.28 into Equation 
11.1.26, we find that 


C-D=0, and C+Dr-D=0. (11.1.39) 


This set of simultaneous equations yields C = D = 0 and we have only trivial solutions for 
À — 0. 
Finally, we examine the case when À > 0. Substituting Equation 11.1.29 into Equation 
11.1.26, we obtain 
E-kF — 0, (11.1.40) 


and 
[cos(k7) + k sin(k7)|E + [sin(kr) — k cos(k7)|F = 0. (11.1.41) 


The elimination of E from Equation 11.1.40 and Equation 11.1.41 gives 
F(1 +k?) sin(kr) = 0. (11.1.42) 
If Equation 11.1.29 is nontrivial, F Z 0, and 
k? — —1, or sin(km) =0. (11.1.43) 
The condition k? = —1 violates the assumption that k is real, which follows from the fact 


that A = k? > 0. On the other hand, we can satisfy sin(kz) = 0 if k = 1,2,3,...; a negative 
k yields the same A. Consequently, we have the additional eigenvalues A,, = n?. 
Let us now find the corresponding eigenfunctions. Because E = kF, y(x) = F sin(kx)+ 


Fkcos(ka) from Equation 11.1.29. Thus, the eigenfunctions for A > 0 are 
Yn(x) = sin(na) + n cos(nx). (11.1.44) 


Figure 11.1.3 illustrates some of the eigenfunctions given by Equation 11.1.34 and Equation 
11.1.44. 


e Example 11.1.4 
Consider now the Sturm-Liouville problem 


y" +y — 0, (11.1.45) 


5 See Chapter 3. 


452 Advanced Engineering Mathematics with MATLAB 


D al L L l s L = L — — $ L l 
0.0 0.5 1.0 1.5 2.0 25 3.0 35 0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 
x x 


Figure 11.1.3: The first four eigenfunctions for the Sturm-Liouville problem, Equation 11.1.25 and Equa- 
tion 11.1.26. 


with 
y(t) =y(—m), and y(r) =y'(—7). (11.1.46) 
This is not a regular Sturm-Liouville problem because the boundary conditions are periodic 


and do not conform to the canonical boundary condition, Equation 11.1.2. 
The general solution to Equation 11.1.45 is 


y(x) = Acosh(mz) + Bsinh(mz), if A= —m? <0, (11.1.47) 
y(x)—C-Dz, if rA=0, (11.1.48) 

and 
y(x) = Ecos(kz)-- Fsin(kz), if A\=k? >0. (11.1.49) 


Substituting these solutions into the boundary condition, Equation 11.1.46, 


A cosh(m) + B sinh(mz) = Acosh(—mo) + Bsinh(—mz), (11.1.50) 
C+ Dr =C — Dr, (11.1.51) 

and 
E cos(kr) + F sin(kr) = E cos(—kr) + F sin(—kr), (11.1.52) 

or 

Bsinh(mr)=0, D=0, and Fsin(kr)= 0, (11.1.53) 
because cosh(—mm) = cosh(mr), sinh(—mm) = —sinh(mr), cos(—kr) = cos(kr), and 
sin(—kr) = — sin(kr). Because m must be positive, sinh(mr) cannot equal zero and B = 0. 
On the other hand, if sin(kr) = 0 or k = n, n = 1,2,3,..., we have a nontrivial solution 


for positive \ and An = n?. Note that we still have A, C, E, and F as free constants. 
From the boundary condition, Equation 11.1.46, 


Asinh(mr) = Asinh(—mz), (11.1.54) 
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and 
—Esin(kz) + F cos(kr) = —Esin(—kn) + F cos(—kn). (11.1.55) 


The solution yo(a) = C identically satisfies the boundary condition, Equation 11.1.46, for 
all C. Because m and sinh(m7) must be positive, A = 0. From Equation 11.1.53, we once 
again have sin(kz) = 0, and k = n. Consequently, the eigenfunction solutions to Equation 
11.1.45 and Equation 11.1.46 are 


Ào — 0, yo(x) = 1, (11.1.56) 
and 
S x£), 
wan dake { jns (11.1.57) 


and we have a degenerate set of eigenfunctions to the Sturm-Liouville problem, Equation 
11.1.45, with the periodic boundary condition, Equation 11.1.46. 


Problems 


Find the eigenvalues and eigenfunctions for each of the following: 


1. y" -FAy —0, y/(0)=0, y(L)-0 


4. y” +y —0, y(0)20, y(t) —y'(r) =0 
5. 6? +ry=0, y(0—y"(0 —0, y(L)-y"(D)-0 


Find an equation from which you could find A and give the form of the eigenfunction for 
each of the following: 


6. y” -Ày—0, y(0)+y(0) =0, y(1)=0 


7. y Ay 20, y(0)=0, y(m) + y(n) =0 


(rn) due l<a<e 


for each of the following boundary conditions: (a) u(1) = u(e) = 0, (b) u(1) = u’(e) = 0, 
and (c) u’(1) 2 w'(e) = 0. 
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Step 1: Using the transformation 7 = ln(x), show that we can transform the differential 
equation into 

Tied dee 

dn? y a. — 7] — 
State the boundary conditions that will now occur at 7 = 0 and 7 = 1. 


Step 2: Solve this new differential equation for the three separate cases of A < 0, A = 0 and 
À > 0. 


Step 3: Transform any nontrivial solutions back into the dependent variable x. 
12. Find the eigenvalues and eigenfunctions of the following Sturm-Liouville problem: 
z?^y" + 2zy! + Ay = 0, y(1) = y(e) = 0, l<a<e. 


Step 1: Show that our Sturm-Liouville equation can be rewritten 


d 
z(xy" 4- y) t xy! +rAy = 0, or qx nu He- + dy =0. 
dx \ dz 


Step 2: Using the transformation 7 = In(x), show that we can transform the second differ- 
ential equation into 


d^y dy 
UM REM = «n&l. 
am uat 0, 0<n< 


State the boundary condition now at 7 = 0 and 7 = 1. 


Step 3: Solve this new differential equation for the three separate cases of A < 0, A = 0 and 
A > 0. 


Step 4: Transform any nontrivial solutions back into the dependent variable x. 


13. Find the eigenvalues and eigenfunctions of the following Sturm-Liouville problem: 


d 
a; v) c Axy =0, y(1) = yle") — 0, 1l<a<e™. 


Step 1: Show that our Sturm-Liouville equation can be rewritten 


d d 
x(acy’+y')+2ry'+A\Ay=0 o 2 a) +22 
dx \ dx 


Step 2: Using the transformation 7 = ln(x), show that we can transform the second differ- 
ential equation in Step 1 into 


dy | jdy 

— +2—+ry=0 <n<n. 
dd + di + AY ] 0zntzm 
State the boundary condition now at 7 = 0 and 7 = 1. 


Step 3: Solve this new differential equation for the three separate cases of A < 0, A = 0 and 
A > 0. 


Step 4: Transform any nontrivial solutions back into the dependent variable x. 
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14. Find the eigenvalues and eigenfunctions of the following Sturm-Liouville problem: 


d/l, À 
y= 1)= = E E 
zw) a 0  y(1)-w9-20 1<aK<e 


Step 1: Show that our Sturm-Liouville equation can be rewritten 


d d d 
z(zy" + y) — 2Qay' + ày = 0 or T (s) 2x Y + Ay = 0. 


Step 2: Using the transformation 7 = In(x), show that we can transform the second differ- 
ential equation in Step 1 into 


d'y dy 

— —-2— + Ay=0 0<n<l. 
di dn + Ay = 0, sng 
State the boundary condition now at 7 = 0 and 7 = 1. 


Step 3: Solve this new differential equation for the three separate cases of A < 0, A = 0 and 
À » 0. 


Step 4: Transform any nontrivial solutions back into the dependent variable x. 


15. Find the eigenvalues and eigenfunctions of the following problem: 


yes My =0, y” (0) 5 y"(0) =y”) = y'(1) = 0, 0 «c zc « I. 


Step 1: Show that if A* < 0, we can write \4 = k*e7? with k > 0. In this case, the solution 
is y(x) = Ae^:* + Be* + Ceò? + De^*, where àq = ke™*/4, X, = ke®™/4, Ag = keSri/4. 
M= ke? 7i/4. 


Step 2: By substituting the solution from Step 1 into the boundary conditions, show that 
you have a trivial solution for A^ < 0. 


Step 3: Show that A* = 0, then y(x) = A+ Bz + Cz? + Dz?. 


Step 4: By substituting the solution from Step 3 into the boundary conditions, show that 
the eigenfunction is yo(r) = 1. 


Step 5: Show that for A* > 0, then y(x) = A cosh(Ax) + B sinh(Az) +C cos(Az) + B sin(Ax)). 
Step 6: By substituting the solution from Step 5 into the boundary conditions, show that 
the eigenfunction is y, (z) = cosh(Anx) + cos(Anx) — tanh (An [sinh (Anz) + sin(A42z)], where 
An satisfies the equation tanh(A) = — tan(A) and n = 1,2,3,.... 


Project: Numerical Solution of the Sturm-Liouville Problem 


You may have been struck by the similarity of the algebraic eigenvalue problem to the 
Sturm-Liouville problem. (See Section 3.5.) In both cases, nontrivial solutions exist only 
for characteristic values of A. The purpose of this project is to further deepen your insight 
into these similarities. This project requires a knowledge of matrix algebra (see Sections 
3.1 and 3.4). 
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A» Ax c4 


Figure 11.1.4: Schematic for finite-differencing a Sturm-Liouville problem into a set of difference equations. 
Consider the Sturm-Liouville problem 
y" -- Ay — 0, y(0) = y(r) = 0. (11.1.58) 


We know that it has the nontrivial solutions Aj, = m?, Ym(x) = sin(mz), where m = 
Tod eie 


Step 1: Let us solve this problem numerically. Introducing centered finite differencing and 
the grid shown in Figure 11.1.4, show that 


nm  Yntl — 2Yn + Yn-1 
(Az)? 


where y, = y(z,), z4 = nAz and Az = «/(N +1). Show that the finite-differenced form 
of Equation 11.1.58 is 

—h yny + 2h), — h^y a = Ayn (11.1.59) 
with yo = yn41 = 0, and h = 1/(Ax). 


Step 2: Solve Equation 11.1.59 as an algebraic eigenvalue problem using N = 1,2,.... Show 
that it can be written in the matrix form of 


2h? —h? 0 RS 0 0 0 Ui Ui 

—h? 2h? —h? .. 0 0 0 Y2 Y2 
0 =k? 2 ues. CX 0 0 m m 
us 4 =A] . (11.1.60) 
0 0 0 ues —h? 2h? —h? YN-1 YN-1 


Note that the coefficient matrix is symmetric. 


Step 3: You are now ready to compute the eigenvalues. For small N this could be done by 
hand. However, it is easier just to write a MATLAB program that will handle any N > 2. 
Table 11.1.2 has been provided so that you can check your program. 

With your program, answer the following questions: How do your computed eigenvalues 
compare to the eigenvalues given by the Sturm-Liouville problem, Equation 11.1.58? What 
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Table 11.1.2: Eigenvalues Am, Ordered According to Increasing Magnitude, Computed 
from Equation 11.1.60 as a Numerical Approximation of the Sturm-Liouville Problem, 
Equation 11.1.58. 


N à À2 Àa A4 As ^e Ar 

1 0.81057 

2 0.91189 2.73567 

3 0.94964 3.24228 5.53491 

4 0.96753 3.50056 6.63156 9.16459 

5 0.97736 3.64756 7.29513 10.94269 13.61289 

6 0.98333 3.73855 7.71996 12.13899 16.12040 18.87563 

7 0.98721 3.79857 8.00605 12.96911 17.93217 22.13966 24.95100 
8 0.98989 3.84016 8.20702 13.56377 19.26430 24.62105 28.98791 


20 0.99813 3.97023 8.84993 15.52822 23.85591 33.64694 44.68265 
50 0.99972 3.99498 8.97438 15.91922 24.80297 35.59203 48.24538 


happens as you increase N? Which computed eigenvalues agree best with those given by 
the Sturm-Liouville problem, Equation 11.1.58? Which ones compare the worst? 


Step 4: Let us examine the eigenvectors now. Starting with the smallest eigenvalue (number 
it m = 1), use MATLAB to plot the corresponding mth eigenvector Cy” as a function of x, 
n=1,2,...,N,m=1,2,...,N, and C is chosen so that C? Az Y, [y]? = 1. On the same 
plot, graph ys (x) = \/2/m sin(mz). Why did we choose C as we did? Which eigenvectors 
and eigenfunctions agree the best? Which eigenvectors and eigenfunctions agree the worst? 
Why? Why are there N eigenvectors and an infinite number of eigenfunctions? 


Step 5: As we show in the next section, the most important property of eigenfunctions is 
orthogonality. But what do we mean by orthogonality in the case of eigenvectors? Recall 
from three-dimensional vectors we had the scalar dot product 


a-b= aıbı + ab + a3b3. 


For n-dimensional vectors, this dot product is generalized to the inner product 


x:y= »3 TkYk. 
k=1 
Orthogonality implies that x-y = 0 if x Z y. Are your eigenvectors orthogonal? 
11.2 ORTHOGONALITY OF EIGENFUNCTIONS 


In the previous section we saw how nontrivial solutions to the regular Sturm-Liouville 
problem consist of eigenvalues and eigenfunctions. The most important property of eigen- 
functions is orthogonality. 
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Theorem: Let the functions p(x), q(x), and r(x) of the regular Sturm-Liouville problem, 
Equation 11.1.1 and Equation 11.1.2, be real and continuous on the interval [a,b]. If yn (x) 
and Ym(x) are continuously differentiable eigenfunctions corresponding to the distinct eigen- 
values An and Am, respectively, then Yn(x) and Ym(x) satisfy the orthogonality condition: 


b 
f r(z)yn(z)um(x) dz = 0, (11.2.1) 


if An # àm. When Equation 11.2.1 is satisfied, the eigenfunctions y,(r) and y (x) are 
said to be orthogonal to each other with respect to the weight function r(x). The term 
orthogonality appears to be borrowed from linear algebra where a similar relationship holds 
between two perpendicular or orthogonal vectors. 


Proof: Let Yn(x) and y»(x) denote the eigenfunctions associated with two different eigen- 
values A, and Am. Then 


4 pe] + [a() + Aur(x)]us (x) = 0, (11.2.2) 
< (a) | + (a(x)  Amr(x)]ym (x) = 0, (11.2.3) 


and both solutions satisfy the boundary conditions. Let us multiply the first differential 
equation by ym; the second by yn. Next, we subtract these two equations and move the 
terms containing YnYm to the right side. The resulting equation is 


d 
Yn da 


a) - tn p | = On — Aram. (11.24) 


Integrating Equation 11.2.4 from a to b yields 


f o. = cay He Ym E Lord j dx = (An — Am) [ res dr. (11.2.5) 


We can simplify the left side of Equation 11.2.5 by integrating by parts to give 


[pibot] e [oer de] } 
b 


ee Oren f pl. — Yavin] dx. (11.2.6) 


a 


The second integral equals zero since the integrand vanishes identically. Because yn (x) and 
Ym(x) satisfy the boundary condition at x = a, 


ay (a) T Byn (a) =0, (11.2.7) 


and 


AYmla) + bym (a) = 0. (11.2.8) 


The Sturm-Liouville Problem 459 


These two equations are simultaneous equations in a and 3. Hence, the determinant of the 
equations must be zero: 


y, (a)um (a) — yi. (a)us (a) = 0. (11.2.9) 
Similarly, at the other end, 
yn (b) (b) — Yin (b)ys (b) = 0. (11.2.10) 


Consequently, the right side of Equation 11.2.6 vanishes and Equation 11.2.5 reduces to 
Equation 11.2.1. 


e Example 11.2.1 


Let us verify the orthogonality condition for the eigenfunctions that we found in Ex- 
ample 11.1.1. 

Because r(x) = 1, a = 0, 6 = s, y_1(x) = sinh(m. 1x) and ys(x) = sin(k,z), we find 
that 


b T 
/ r(z)ysym dx = | sinh(m_12) sin(ky,x) dx (11.2.11) 
a 0 
| m_1cosh(m_12) sin(km) — km sinh(m_12) cos(km2) |" (11.2.12) 
= ee ; 2. 
mı cosh(m 47) sin(km7) — km sinh(m. 47) cos(km7) 
= os (11.2.13) 
d m 

- 0, (11.2.14) 


since sinh(m_ 7) = m. 1 cosh(m. 1x) and sin(k,7) = kn cos(k, 7). Similarly, if n, m > 0, 


b T 
j r(£)YnYm dx -f sin(k,z) sin(kim x) dx (11.2.15) 
ce af {cos[(Kn — km)x] — cos[(Kn + km)a]} da (11.2.16) 
sin[(Kkn — k&)z]|"  sin[(kn + km)a] |" 
Sey i oe ea (11.2.17) 
_ sin[(k, — tnd sin|(kn + km) 
i CES De e (11.2.18) 
_ sin(kn7) cos(kam) — cos(kn T) sin(Km m) 
2(Kin = km) 
sin(k,7) cos(kmm) + cos(k,7) sin(km) 
2(Ken + Brn) (11.2.19) 
| kn cos(knt) cos(kmm™) — km Co8(kn7) Cos(kmT) 
2(kn — km) 
kn cos(kn T) cos(kmT) + km COS(kin 1) COS(Km7) 
CET E (11.2.20) 
_ (kn — km) cos(k,m) cos(km) 
2(kn — km) 
(kn + km) cos(kn7) Cos(kmn7) za. (11.2.21) 


2(kn + km) 
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We used the relationships kn = tan(k,, 7), and km = tan(k,,7) to simplify Equation 11.2.19. 
Note, however, that 


| sinh(m. 1x) sinh(m_ 2) dz = af [cosh(2m_ x) — 1] dx (11.2.22) 
0 0 


inh(2m_ 
= ene). UE (11.2.23) 
4m_1 2; 


= }[cosh*(m_1m) — n] > 0, (11.2.24) 


since sinh(2A) = 2sinh(A) cosh(A) and sinh(m_i7) = m..4 cosh(m_,7). Similarly, 
| sin(k,z) sin(knx) dz = 2! [1 ^ cos(2k,2)] dx = 7 sin(2k,m) = lig — cos? (k,m)] > 0, 
0 0 


2 4k,, 
(11.2.25) 
because sin(2A) = 2sin(A) cos(A), and kn = tan(k, s). That is, any eigenfunction cannot 
be orthogonal to itself. 


In closing, we note that had we defined the eigenfunction in our example as 


sinh(m. 1x) 


y-1(x) = 
y[cosh?(m-17) — s]/2 


(11.2.26) 


and 
sin(k,z) 


7 — cos?(k,)]/2 


(11.2.27) 


rather than y 1(x) = sinh(m. 1x) and y,(x) = sin(k,x), the orthogonality condition would 
read 


ri Un (r)um (x) dz = { i H f ie (11.2.28) 
where n,m = —1,1,2,3,.... This process of normalizing an eigenfunction so that the 
orthogonality condition becomes 

° 0, mn, 

A r(z)yn (x)ym() dz = { e db (11.2.29) 


generates orthonormal eigenfunctions. We will see the convenience of doing this in the next 
section. 


Problems 


1. The Sturm-Liouville problem y” +Ay = 0, y(0) = y(L) = 0 has the eigenfunction solution 
Yn(x) = sin(nzx/L). By direct integration, verify the orthogonality condition, Equation 
11.2.1. 


2. The Sturm-Liouville problem y" + Ay = 0, y'(0) = y'(D) = 0 has the eigenfunction 
solutions yo(x) = 1 and y, (x) = cos(nzx/L). By direct integration, verify the orthogonality 
condition, Equation 11.2.1. 
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3. The Sturm-Liouville problem y" + Ay = 0, y(0) = y'(D) = 0 has the eigenfunction 
solution y,(r) = sin[(2n — 1)rz/(2L)|. By direct integration, verify the orthogonality 
condition, Equation 11.2.1. 


4. The Sturm-Liouville problem y" + Ay = 0, y'(0) = y(L) = 0 has the eigenfunction 
solution y,(r) = cos|(2n — l)rz/(2L)]. By direct integration, verify the orthogonality 
condition, Equation 11.2.1. 


11.3 EXPANSION IN SERIES OF EIGENFUNCTIONS 


In calculus we learned that under certain conditions we could represent a function 
f(x) by a linear and infinite sum of polynomials (x — xo)”. In this section we show that an 
analogous procedure exists for representing a piece-wise continuous function by a linear sum 
of eigenfunctions. These eigenfunction expansions will be used to solve partial differential 
equations. 

Let the function f(a) be defined in the interval a < x < b. We wish to re-express f(x) 
in terms of the eigenfunctions y,(r) given by a regular Sturm-Liouville problem. Assuming 
that the function f(x) can be represented by a uniformly convergent series, we write 


f(z) = >> epa (2). (11.3.1) 


n=1 


The orthogonality relation, Equation 11.2.1, gives us the method for computing the coeffi- 
cients cn. First we multiply both sides of Equation 11.3.1 by r(x)ym(x), where m is a fixed 
integer, and then integrate from a to b. Because this series is uniformly convergent and 
Yn(x) is continuous, we can integrate the series term by term, or 


b 9o b 
T r(z)f (z)yas (x) dz = DN r(z)ys (x)ym(x) da. (11.3.2) 


=1 


The orthogonality relationship states that all of the terms on the right side of Equation 
11.3.2 must disappear except the one for which n = m. Thus, we are left with 


b 


b 
/ r(z)f(z)ym(z) dz = cs [ r(z)ym(x)ym(x) dz (11.3.3) 


a 


or 


8 > 
E 
A 


rem (5) Gov) i (11.3.4) 


Ja? (@) yn (a) dar 


$ If Sn(z) = $5, urls), S(x) = limn+oo Sn(x), and 0 < |Sn(x) — S(x)| < e for all n > M > 0, the 


series M ou uj (x) is uniformly convergent if M is dependent on € alone and not zx. 


462 Advanced Engineering Mathematics with MATLAB 


if we replace m by n in Equation 11.3.3. 

Usually, both integrals in Equation 11.3.4 are evaluated by direct integration. In the 
case when the evaluation of the denominator is very difficult, Lockshin’ has shown that the 
denominator of Equation 11.3.4 always equals 


b 


2 
Oy y Ou | (11.3.5) 


n Ser G) de pli EE -v 


for a regular Sturm-Liouville problem with eigenfunction solution y, where p(x), q(x), and 
r(x) are continuously differentiable on the interval [a,b]. 

'The series, Equation 11.3.1, with the coefficients found by Equation 11.3.4, is a general- 
ized Fourier series of the function f(a) with respect to the eigenfunction y, (x). It is called 
a generalized Fourier series because we generalized the procedure of re-expressing a function 
f(x) by sines and cosines into one involving solutions to regular Sturm-Liouville problems. 
Note that if we had used an orthonormal set of eigenfunctions, then the denominator of 
Equation 11.3.4 would equal one and we reduce our work by half. The coefficients cn are 
the Fourier coefficients. 

One of the most remarkable facts about generalized Fourier series is their applicability 
even when the function has a finite number of bounded discontinuities in the range [a, t]. 
We may formally express this fact by the following theorem: 


, 
a 


Theorem: Jf both f(x) and f'(x) are piece-wise continuous in a € x < b, then f(x) can be 
expanded in a uniformly convergent Fourier series, Equation 11.3.1, whose coefficients Cy 
are given by Equation 11.3.4. It converges to [f (x^) + f(z-)]/2 at any point x in the open 
interval a < x < b. 


The proof is beyond the scope of this book but can be found in more advanced treatises.® 
If we are willing to include stronger constraints, we can make even stronger statements 
about convergence. For example,’ if we require that f(x) be a continuous function with 
a piece-wise continuous first derivative, then the eigenfunction expansion, Equation 11.3.1, 
converges to f(x) uniformly and absolutely in [a,b] if f(a) satisfies the same boundary 
conditions as does y, (x). 


In the case when f(x) is discontinuous, we are not merely rewriting f(x) in a new form. 
We are actually choosing the coefficients cn so that the eigenfunction expansion fits f(a) in 
the “least squares” sense that 


rj ^ 


Consequently we should expect peculiar things, such as spurious oscillations, to occur in 
the neighborhood of the discontinuity. These are Gibbs phenomena,!? the same phenomena 
discovered with Fourier series. See Section 5.2. 


2 
dx = 0. (11.3.6) 


f(z) - 5 Cyn (x) 


7 Lockshin, J. L, 2001: Explicit closed-form expression for eigenfunction norms. Appl. Math. Lett., 14, 
553-555. 


8 For example, Titchmarsh, E. C., 1962: Eigenfunction Expansions Associated with Second-Order Dif- 
ferential Equations. Part 1. Oxford University Press, pp. 12-16. 


9 Tolstov, G. P., 1962: Fourier Series. Dover Publishers, p. 255. 


10 Apparently first discussed by Weyl, H., 1910: Die Gibbs’sche Erscheinung in der Theorie der Sturm- 
Liouvilleschen Reihen. Rend. Circ. Mat. Palermo, 29, 321—323. 
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e Example 11.3.1 


To illustrate the concept of an eigenfunction expansion, let us find the expansion for 
f(x) = x over the interval 0 < x < m using the solution to the regular Sturm-Liouville 
problem of 


y" + Ay — 0, y(0) = y(r) = 0. (11.3.7) 
This problem arises when we solve the wave or heat equation by separation of variables. 
Because the eigenfunctions are y,(x) = sin(nx), n = 1,2,3,..., r(x) = 1, a = 0, and 
b = 7, Equation 11.3.4 yields 
"rsi d —z cos(nz)/n + sin(nz)/n? |7 2 2 
me Ja een (n) Yo ( n ( y l5 - Bas ees ey 
Jo sin^ (nz) dx z/2 — sin(2nz)/(4n)]|o n n 
(11.3.8) 
Equation 11.3.1 then gives 
f(a) = —2 D Er sin(nz) (11.3.9) 
2. n f 3. 


This particular example is in fact an example of a half-range sine expansion. 

Finally, we must state the values of x for which Equation 11.3.9 is valid. At x = 7 the 
series converges to zero while f(a) = 7. At x = 0 both the series and the function converge 
to zero. Hence this series expansion is valid for 0 € x < 7. 


e Example 11.3.2 


For our second example let us find the expansion for f(x) = x over the interval 0 € 
x < c using the solution to the regular Sturm-Liouville problem of 


y" +Ay — 0, y(0) = y(r) — y' (r) ^ 0. (11.3.10) 


We will encounter this problem when we solve the heat equation with radiative boundary 
conditions by separation of variables. 

Because r(x) = 1, a = 0, b = v, and the eigenfunctions are y 1(x) = sinh(m. 1x) and 
yn(x) = sin(k,z), where sinh(m..1) = m..4 cosh(m. 1) and kn = tan(k,x), Equation 11.3.4 
yields 


» Jo. zsinh(m-iz)dz _ te x sinh(m_ a) dx (11.3.11) 
— ja sinh?(m iz)dz — $ Jj [cosh(2m.12) — 1] dx = 


EE Eos meg mie — sinh(m.12)/m?, |; (11.3.12) 
sinh(2m. 12)/(2m..1) — z|o 


_ 2r gostote ir i — 2sinh(m-17)/mŽ, (11.3.13) 
sinh(2m—ır)/(2m—1)— x 


_ 2(7 = 1) cosh(m-17)/m-1 (11.3.14) 
cosh?’ (m17) — 7 ' 2 


C—1 


where we used the property that sinh(m. 1x) = m_, cosh(m. 12); and 
fo vsin(k,a) da Jo xsin(knz)de  2sin(knz)/k} — 2x cos(knæ)/kn|o 


n= ffsmi(ku)ds Lfe [1 — cos(2k,x)] dz x — sin(2k,z)/ (2k, )] 
(11.3.15) 


i 2sin(k,n)/k2 — 2m cos(k,n)/k, ^ 2(1— m) cos(k,m)/ ky 


= 11.3.16 
7 — sin(2k,7)/(2kn) m — cos? (knr)  ' ( ) 


464 Advanced Engineering Mathematics with MATLAB 


wo 


0 0.2 0.4 0.6 0.8 1 0 0.2 0.4 0.6 0.8 1 
XIT XIT 


Figure 11.3.1: The eigenfunction expansion, Equation 11.3.17, for f(x) = x, 0 < a/m < 1, when we 
truncate the series so that it includes only the first, first two, first three, and first four terms. 


where we used the property that sin(k,7) = kn cos(k,7). Equation 11.3.1 then gives 


(11.3.17) 


$a edes [mr sinh(m. 1x) cos(k,,7) sin(k,z) | 


m.i[cosh?(m.i-) — 2] — £4 ks[v — cos? (k,m)] 
Figure 11.3.1 illustrates our eigenfunction expansion of f(x) — x in truncated form when 
we only include one, two, three, and four terms. 

'To illustrate the use of Equation 11.3.5, we note that 


ee Oy — Oy ax F 
y(x) = sin( VAa) b VA cos( VAa) > a= sx ema) ; (11.3.18) 
and E E 
Uc a SO Nes det de ua 
On BxÜA — 2X cos( VX} 5 sin(VA k (11.3.19) 
Therefore, 


"n sin? (vaz) dz = E cos? (vaa) - sin(VAa) 


i Ee 
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ia sin? (vaz) dz = E — A sin(VAa) cos( VAa) } l (11.3.21) 
- ; = A sin(VA«) cos( VAr) (11.3.22) 


If A-1 = —m?,, J/A., = im_, and we obtain Equation 11.2.24 if we use sinh(m_,7) = 
m_ cosh(m_i7). On the other hand, if An = kn, Vn = kn and we obtain Equation 
11.2.25 if we use sin(ky7) = kn cos(k,7). 


e Example 11.3.3: The separation of variables solution to the heat equation 
when the left wall is insulated 


The reason why we developed expansions in orthogonal functions is to solve linear 
partial differential equations with complicated boundary conditions using the technique of 
separation of variables. It is assumed that the reader already understands this technique. 

Let us solve the heat equation 

a L, 0<t 11.3.23 

Ot =a EYE <T< L, <t, ( 9. ) 
which satisfies the initial condition u(zr,0) = x, 0 < x < L, and the boundary conditions 
u;(0,t) = u(L,t) = 0, 0 < t. The condition u,(0,t) = 0 expresses mathematically the 
constraint that no heat flows through the left boundary (insulated end condition). 

Employing separation of variables, the positive and zero separation constants yield 
trivial solutions. For a negative separation constant, however, 


X" -k?X — 0, (11.3.24) 


with X'(0) = X(L) = 0 because u,(0,t) = X'(0)T(t) = 0, and u(L,t) = X(L)T(t) = 0. 
This regular Sturm-Liouville problem has the solution 


(2n — 1)ra 


X,(z) = cos] 3 


| 2,0 n=1,2,3,.... (11.3.25) 


The temporal solution then becomes 


Bom S a? (2n — = | 


"n (11.3.26) 


Consequently, a linear superposition of the particular solutions gives the total solution, 
which equals 


u(x,t) = $B, cos E yo exp gaa Se ] (11.3.27) 


Our final task remains to find the coefficients Bn. Evaluating Equation 11.3.27 at t = 0, 


u(r,0)—r-— bD Bn cos 


n=1 


e - lynz 


3r | ; O0<a<L. (11.3.28) 
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Figure 11.3.2: The temperature u(x, t)/ L within a thin bar as a function of position x/L and time a?t/L? 
when we insulate the left end and hold the right end at the temperature of zero. The initial temperature 
equals x. 


Equation 11.3.28 is not a half-range cosine expansion; it is an expansion in the orthog- 


onal functions cos|(2n — 1)zz/(2L)] corresponding to the regular Sturm-Liouville problem, 
Equation 11.3.24. Consequently, Bn is given by Equation 11.3.4 with r(x) = 1 as 


fo’ x cos((2n — 1)ma/(2L)] de 


B, = 2, (11.3.29) 
fo cos? [(2n — 1)rz/(2L)] dx 
L? (2n-1)zz ||L , Lz ; | (2n-1)zz ||L 
Qu iy cos| 2L | F Can sin| 2L | lo 
= + I (11.3.30) 
2 lo T Sane sin| L | lo 
8L (2n — 1)x 4L . | (2n — 1)r 
1,4 11.3.31 
(2n — 1272 5l 2 | \ (2n — 1yr zl 2 REA 
8L 4L(—1)" 
CU (11.3.32) 


(2n — 1?4?  (2n— D)w' 


as cos((2n — 1)2/2] = 0, and sin[(2n — 1)r/2] = (—1)"*!. Consequently, the complete 
solution is 


sen [us re est] ne 


n=1 
(11.3.33) 


Figure 11.3.2 illustrates the evolution of the temperature field with time. It was gen- 
erated using the MATLAB script: 
clear 
M = 200; dx = 0.02; dt = 0.05; 
% compute Fourier coefficients 
sign = -1; 
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for m = 1:M 
tempi = 2*m-1; 
a(m) = 2/(pi*tempi*tempi) + sign/temp1; 
sign = - sign; 
end 
^4 compute grid and initialize solution 
X = [0:dx:1]; T = [0:dt:1]; 
u = zeros(length(T) , length (X)) ; 
XX = repmat(X,[length(T) 1]); 
TT = repmat(T?,[1 length OO]); 
^4 compute solution from Equation 11.3.33 
for m - 1:M 
tempi = (2*m-1)*pi/2; 
u = u + a(m) * cos(temp1*XX) .* exp(-temp1 * tempi * TT); 


u-- (4/pi) * u; 

surf (XX,TT,u); axis([O 1 O 1 O 1]); 

xlabel(C DISTANCE?,?Fontsize?,20); ylabel(?TIME?,?Fontsize?,20) 
zlabel(’SOLUTION’ ,’Fontsize’ ,20) 


Initially, heat near the center of the bar flows toward the cooler, insulated end, resulting in 
an increase of temperature there. On the right side, heat flows out of the bar because the 
temperature is maintained at zero at x = L. Eventually the heat that has accumulated at 
the left end flows rightward because of the continual heat loss on the right end. In the limit 
of t — oo, all of the heat has left the bar. 


e Example 11.3.4: The separation of variables solution to the heat equation 
with a radiation boundary condition 


As our second example of how a Sturm-Liouville problem arises during the solution of 
a partial differential equation, we solve the heat equation by separation of variables when 
the temperature or flux of heat has been specified at the ends of the rod. In many physical 
applications, one or both of the ends may radiate to free space at temperature ug. According 
to Stefan's law, the amount of heat radiated from a given area dA in a given time interval 
dt is c(u* — u$) dA dt, where c is called the Stefan-Boltzmann constant. On the other hand, 
the amount of heat that reaches the surface from the interior of the body, assuming that 
we are at the right end of the bar, equals —& uz dA dt, where & is the thermal conductivity. 
Because these quantities must be equal, 


Ou 4 


—K— = g(uf — ug) = o(u — ug) (u? + u’uo + uug + ug). (11.3.34) 
If u and up are nearly equal, we may approximate the second bracketed term on the right 
side of Equation 11.3.34 as 4ug. We write this approximate form of Equation 11.3.34 as 


cM Lnd tug); (11.3.35) 


where h, the surface conductance or the coefficient of surface heat transfer, equals 4cug/k. 
Equation 11.3.35 is a “radiation” boundary condition. Sometimes someone will refer to it 
as “Newton’s law” because this equation is mathematically identical to Newton's law of 
cooling of a body by forced convection. 
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Table 11.3.1: The First Ten Roots of a+hLtan(a) = 0 and C, for hL = 1 


n An Approximate ay, Ch 

1 2.0288 2.2074 118.9221 
2 4.9132 4.9246 31.3414 
3 7.9787 7.9813 27.7549 
4 11.0855 11.0865 16.2891 
5 14.2074 14.2079 14.9916 
6 17.3364 17.3366 10.8362 
7 20.4692 20.4693 10.2232 
8 23.6043 23.6044 8.0999 
9 26.7409 26.7410 7.7479 
10 29.8786 29.8786 6.4626 


Let us now solve the problem of a rod that we initially heat to the uniform temperature 
of 100. We then allow it to cool by maintaining the temperature at zero at x = 0 and 
radiatively cooling to the surrounding air at the temperature of zero!! at x = L. We may 
restate the problem as 


Ou 0u 
ALMA I 0 L, 0«t 11.3.36 
a ^ au seed. Weg ( ) 
with the initial condition u(x,0) = 100, 0 < x < L, and the boundary conditions u(0, t) = 
us(L,t) + hu(L,t) 70,0 « t. 

Once again, we assume a product solution u(x,t) = X(x)T(t) with a negative separa- 
tion constant so that 


» c qu 
= =k’. (11.3.37) 
X a?T 
We obtain for the z-dependence that 
X" +k?’ X — 0, (11.3.38) 


but the boundary conditions are now X(0) = X'(L)-- &X(L) = 0. The most general 
solution of Equation 11.3.38 is X(x) = Acos(ka) + Bsin(kr). However, A = 0, because 
X(0) = 0. On the other hand, 


k cos(kL) + hsin(kL) = kL cos(kL) + hLsin(kL) = 0, (11.3.39) 


if B Z 0. The nondimensional number AL is the Biot number and depends completely upon 
the physical characteristics of the rod. 

In Example 11.1.1 we saw how to find the roots of the transcendental equation a + 
hL tan(a) = 0, where a = kL. Consequently, if a, is the nth root of this equation, then the 
eigenfunction is X,(r) = sin(a,x/L). In Table 11.3.1, we list the first ten a,,’s for AL = 1. 


11 Although this would appear to make h — 0, we have merely chosen a temperature scale so that the 
air temperature is zero and the absolute temperature used in Stefan's law is nonzero. 
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In general, we must find the roots either numerically or graphically. If œ is large, 
however, we can find approximate values!? by noting that 


cot(a) = —hL/a x 0, or an = (2n — 1)1/2, (11.3.40) 


where n = 1,2,3,.... We can obtain a better approximation by setting a, = (2n — 1)x/2— 
En, where e, « 1. Substituting into a+ hL tan(a) = 0, we find that 


[(2n — 1)»/2 — en] cot[(2n — 1)x/2 — en] + AL — 0. (11.3.41) 
We can simplify Equation 11.3.41 to 
€ + (2n — 1)re, /2 4- AL = 0, (11.3.42) 
because cot[(2n — 1)»/2 — 6] = tan(0), and tan(0) ~ 0 for 0 «& 1. Solving for e, , 


2hL anh (Qn—1)m , 2hL 
En & — n An FÉ 
(2n — 1)r 2 (2n — 1)x 


(11.3.43) 


In Table 11.3.1 we compare the approximate roots given by Equation 11.3.43 with the actual 
roots. 
Returning to the method of separation of variables, the temporal part equals 


2.2 o2 a?t 
Tp (t) = C, exp(-k,a*t) = C, exp(- T2 ) : (11.3.44) 
Consequently, the general solution is 
eo n 2 2t 
u(z,t) = Y On sin( %7) ew( E ) (11.3.45) 
n=1 


where a,, is the nth root of a+ hL tan(a) = 0. 
To determine C,, we use the initial condition u(x,0) = 100 and find that 


100 = Y Cn sin (%7) i (11.3.46) 
n=1 


Equation 11.3.46 is an eigenfunction expansion of 100 employing the eigenfunctions from 
the Sturm-Liouville problem 
X"+h?X — 0, (11.3.47) 


12 Using the same technique, Stevens and Luck [Stevens, J. W., and R. Luck, 1999: Explicit approxima- 
tions for all eigenvalues of the 1-D transient heat conduction equations. Heat Transfer Eng., 20(2), 35-41] 
have found approximate solutions to Çn tan(¢n) = Bi. They showed that 


-B + VB? — 4C 
Gn y Zn H , 
2 
where 
B = zn + (1 + Bi) tan(za), C = Bi — zn tan(zn), 


Zn FC 221029 [e =(n-3)n 
"D T "AN Biten]’ yes Aj 
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Figure 11.3.3: The temperature u(x,t) within a thin bar as a function of position z/L and time a?t/L? 
when we allow the bar to radiatively cool at x = L while the temperature is zero at x = 0. Initially the 
temperature was 100. 


with the boundary conditions X(0) = X’(L)+hX(L) = 0. Thus, the coefficient C, is given 
by Equation 11.3.4 or 


B E 100 sin(a,2/L) dz 


n = (11.3.48) 
fo, sin? (oz/L) dx 
as r(x) = 1. Performing the integrations, 
100L|1 — n ü 200|1 — n 
Esse [ cos(an)]/an _ [ iiic )l (baa) 
i[L — Lsin(2an)/(2an)] ^ o«[1 + cos? (an)/(hL)] 
because sin(2a,) = 2cos(o4) sin(a,), and a, = —hL tan(a,,). The complete solution is 
— 200[1 — cos(an)] (Ont a? a*t 
t) = 3 11.3.50 
ulz, t) =>) anll + cos? (as, )/(AL)] sin( L ) ud 72 p 


n=l 


Figure 11.3.3 illustrates this solution for hL = 1 at various times and positions. It was 
generated using the MATLAB script: 

clear 

hL = 1; M = 200; dx = 0.02; dt = 0.02; 

^ create initial guess at alphan 

zero = zeros(M,1); 


for n = 1:M 
temp = (2*n-1)*pi; zero(n) = 0.5*temp + 2*hL/temp; 
end; 


% use Newton-Raphson method to improve values of alphan 
for n = 1:M; for k = 1:10 
f = zero(n) + hL * tan(zero(n)); fp =1 + hL * sec(zero(n))^2; 
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zero(n) = zero(n) - f / fp; 
end; end; 
% compute Fourier coefficients 
for m = 1:M 
a(m) = 200*(1-cos(zero(m)))/(zero(m)*(1*cos(zero(m))^2/hL)); 
end 
^4 compute grid and initialize solution 
X [0:dx:1]; T = [0:dt:0.5]; 
u = zeros(length(T) ,length(X)) ; 
XX = repmat(X,[length(T) 1]); 
TT = repmat(T?,[1 length(X)]); 
^4 compute solution from Equation 11.3.50 
for m = 1:M 
u = u + a(m) * sin(zero(m)*XX) .* exp(-zero(m)*zero(m)*IT); 
end 
surf (XX,TT,u) 
xlabel(’DISTANCE’ ,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel(’?U(X,T)’,’Fontsize’ ,20) 


The heat lost to the environment occurs either because the temperature at an end is zero 
or because it radiates heat to space that has the temperature of zero. 


e Example 11.3.5: Duhamel’s theorem for the heat equation 


In addition to finding solutions to heat conduction problems with time-dependent 
boundary conditions, we can also apply the superposition integral to the nonhomogeneous 
heat equation when the source depends on time. Jeglicl? used this technique in obtaining 
the temperature distribution within a slab heated by alternating electric current. If we 
assume that the flat plate has a surface area A and depth L, then the heat equation for the 
plate when electrically heated by an alternating current of frequency w is 


= 7 sin? (ut), Deae ode (11.3.51) 


where q is the average heat rate caused by the current, p is the density, Cp is the specific heat 
at constant pressure, and a? is the diffusivity of the slab. We will assume that we insulated 
the inner wall so that u,(0,t) = 0, 0 < t, while we allow the outer wall to radiatively cool 
to free space at the temperature of zero or Ku,(L,t) + hu(L,t) = 0, 0 < t, where & is 
the thermal conductivity and À is the heat transfer coefficient. The slab is initially at the 
temperature of zero u(z,0) 2 0, 0 « z « L. 

'To solve the heat equation, we first solve the simpler problem of 


0A 407A 
— —a —-—l1 L t 11.3.52 
a ae : O0<a<L, 0<t, ( 52) 


13 Jeglic, F. A., 1962: An analytical determination of temperature oscillations in a wall heated by 
alternating current. NASA Tech. Note No. D-1286. In a similar vein, Al-Nimr and Abdallah (Al-Nimr, 
M. A., and M. R. Abdallah, 1999: Thermal behavior of insulated electric wires producing pulsating signals. 
Heat Transfer Eng., 20(4), 62-74) found the heat transfer with an insulated wire that carries an alternating 
current. 
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Table 11.3.2: The First Six Roots of the Equation kn tan(kn) = h* 
h* ky k2 k3 k4 ks ke 


0.001 0.03162 3.14191 6.28334 9.42488 12.56645 15.70803 
0.002 0.04471 3.14223 6.28350 9.42499 12.56653 15.70809 
0.005 0.07065 3.14318 6.28398 9.42531 12.56677 15.70828 
0.010 0.09830 3.14477 6.28478 9.42584 12.56717 15.70860 
0.020 0.14095 3.14795 6.28637 9.42690 12.56796 15.70924 
0.050 0.22176 3.15743 6.29113 9.43008 12.57035 15.71115 
0.100 0.31105 3.17310 6.29906 9.43538 12.57432 15.71433 
0.200 0.43284 3.20393 6.31485 9.44595 12.58226 15.72068 
0.500 0.65327 3.29231 6.36162 9.47748 12.60601 15.73972 
1.000 0.86033 3.42562 6.43730 9.52933 12.64529 15.77128 
2.000 1.07687 3.64360 6.57833 9.62956 12.72230 15.83361 
5.000 1.31384 4.03357 6.90960 9.89275 12.93522 16.01066 
10.000 1.42887 4.30580 7.22811 10.20026 13.21418 16.25336 
20.000 1.49613 4.49148 7.49541 10.51167 13.54198 16.58640 
oo 1.57080 4.71239 7.853899 10.99557 14.13717 17.27876 


with the boundary conditions A,;(0,t) = KA,(L,t) + hA(L,t) = 0, 0 < t, and the initial 
condition A(z,0) — 0, 0 < x < L. The solution A(z, t) is the indicial admittance because it 
is the response of a system to forcing by the step function H(t). 

We solve Equation 11.3.52 by separation of variables. We begin by assuming that 
A(x,t) consists of a steady-state solution w(x) plus a transient solution u(x,t), where 


aw" (x) = —1, 0<z< L, (11.3.53) 
subject to the boundary conditions w'(0) = Kw’ (L) + hw(L) = 0 and 
Ov | 40?v 
=a L 11.3.54 
or^" Bg 0<ar<L, (11.3.54) 


with the boundary conditions v,(0,t) = &v,(L,t) + hv(L,t) = 0, 0 < t, and the initial 
condition that v(#,0) 2 —w(xz), 0 « x < L. 
Solving Equation 11.3.53, 


( jecur ne (11.3.55) 
w(x 23 had 3. 
Turning to the transient solution u(x,t), we use separation of variables and find that 
= knz d ke 
v(z,t) = P» 263 exp (- T5 ) (11.3.56) 


where kn is the nth root of the transcendental equation: kn tan(kn) = hL/k = h*. Table 
11.3.2 gives the first six roots for various values of hL/k. 

Our final task is to compute Cn. After substituting t = 0 into Equation 11.3.56, we 
are left with an orthogonal expansion of —w(x) using the eigenfunctions cos(k,x/L). From 
the theory of eigenfunction expansions, we have that 

M fo —w(r)cos(kom/L)dm —— —L3 sin(kn)/(a?k3) — 2L? sin(kn) 
fo’ cos? (knar/L) dz L|k, + sin(2kn)/2]/(2kn) ^ a?k;|k, + sin(2k,)/2] 
(11.3.57) 


The Sturm-Liouville Problem 473 


Combining Equation 11.3.56 and Equation 11.3.57, 


2L? C sin(k,) cos(k,z/L) a^ ket 
t)= ce 11.3.58 
Mm) =~“ 2. kl, + sin2k,)/2 PA I2 ) VERSUB) 
Consequently, A(x, t) equals 
L^—a?  &L 21? SS sin(k,)cos(k,z/L) a k2t 
A(x,t) = E 3. 
E ET ee Z Kk, +sin(2kn)/2] ew( Dp ) V9) 


We now wish to use the solution, Equation 11.3.59, to find the temperature distribution 
within the slab when it is heated by a time-dependent source f(t). As in the case of time- 
dependent boundary conditions, we imagine that we can break the process into an infinite 
number of small changes to the heating, which occur at the times t = 71, t = 7, etc. 
Consequently, the temperature distribution at the time t following the change at t = Tn and 
before the change at t = 7441 is 


u(x,t) = f(0)A(a, t) + p» A(xz,t — n)an, (11.3.60) 
k=1 
where 
Afk = f(Tk)— f(Tk-1) and — Ark = Tk — Tk. (11.3.61) 


In the limit of At, — 0, 


u(x,t) = f()46.0) + f A(z,t — 7)f'(r) dr = f (t) A(z,0) +f pees dr. 


(11.3.62) 
In our present problem, 
2q 2 / 2qu 
f(t) pC, AL sin" (wt), and f'(t) OAL sin(2wt) (11.3.63) 
Therefore, 
2qu ; L? — x? KL 
t) — in(2 eS eee 
u(z, t) aa, sin( enl a T ha 
A sin(k,) knz a?k? (t — 7) 
S n d 11.3.64 
a? £4 [s + sin(2kn)/2 west [pe ense 
N q LI? — a? KL ] t 
= xccl D + 2) cos(2wT)|, (11.3.65) 
AL?qu  sin(kn) exp(-a?k2t/ L?) knz k ake 
TL k 2 n 
a?pC,AL £— Kk, + sin(2kn)/2] cos( L hr S r)ex( T? ar 
qL L2 =x? K 
= 1 2wt 
all pnr Ee SRM 
ss Asin(k,) cos(k,/L) 
 kilkn + sin(2kn)/2][4 + atky/(L4w?)] 


ae Geet 
x E sin(2wt) — 2 cos(2wt) + 2 exp (- T2 ) \ (11.3.66) 
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Figure 11.3.4: The nondimensional temperature a? ApC,u(z, t)/qL within a slab that we heat by alter- 
nating electric current as a function of position z/L and time a?t/L? when we insulate the x = 0 end and 
let the x = L end radiate to free space at temperature zero. The initial temperature is zero, hL/& = 1, and 
a? /(L?w) = 1. 


Figure 11.3.4 illustrates Equation 11.3.66 for L/& = 1, and a?/(L?w) = 1. This figure was 
created using the MATLAB script: 


clear 
asq.over omegaL2 = 1; h_star = 1; m = 0; M = 10; 
dx = 0.1; dt = 0.1; 
^4 create initial guess at kn 
zero = zeros(length(M)); 
for n = 1:10000 
ki = O.1*n; k2 = O.1*(n*1); 
prod = ki * tan(k1); 
yi = hstar - prod; y2 = h.star - k2 * tan(k2); 
if (yl*y2 <= 0 & prod < 2 & m < M) m = m+1; zero(m) = ki; end; 
end; 
^ use Newton-Raphson method to improve values of kn 
for n = 1:M; for k = 1:10 
f -hstar - zero(n) * tan(zero(n)); 


fp = - tan(zero(n)) - zero(n) * sec(zero(n))^2; 
zero(n) = zero(n) - f / fp; 
end; end; 


^4 compute grid and initialize solution 

X = [0:dx:1]; T = [0:dt:6]; 

tempi = (0.5 + 1/h_star)*ones(1,length(X)) - O.5*X.*X; 
temp2 = ones(1,length(T)) - cos(2*T); 

u - tempi? * temp2; 

XX = X? * ones(1,length(T)); 

TT = ones(1,length(X))’ * T; 

^4 compute solution from Equation 11.3.66 

for m= 1:M 
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xtempi = zero(m) * zero(m); 

xtemp2 = 4 + asq_over_omegaL2*asq_over_omegaL2*xtemp1*xtemp1 ; 

xtemp3 = asq_over_omegaL2 * xtempi; 

xtemp4 = zero(m) + sin(2*zero(m))/2; 

xtemp5 = asq_over_omegaL2 * xtempi; 

aaaaa = 4 * sin(zero(m)) / (xtemp1 * xtemp2 * xtemp4); 

u = u - aaaaa * cos(zero(m)*X)’ 

* (xtemp5 * sin(2*T) - 2 * cos(2*T) + 2 * exp(-xtemp5 * T)); 

end 
surf(XX,TT,u) 
xlabel(’DISTANCE’ ,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel(’SOLUTION’ , ’Fontsize’ ,20) 
The oscillating solution, reflecting the periodic heating by the alternating current, rapidly 
reaches equilibrium. Because heat is radiated to space at x = L, the temperature is maxi- 
mum at x = 0 at any given instant as heat flows from x = 0 to x = L. 


e Example 11.3.6: Duhamel's theorem and heat conduction 


Consider the following heat conduction problem with time-dependent forcing and/or 
boundary conditions: 


Ou 


-- a? L(u) + f(P, t), 0 « t, (11.3.67) 
B(u-g(Q.t) | 0«t, (11.3.68) 
and 

u(P,0) = h(P), (11.3.69) 

where 

[2] Qu o ðu o ðu 

L(u) = Co T Ci Oz (ra a) + C^» x; (x a) T C3 zs (ss a) ; (11.3.70) 
B(u) =co+e1 v Fco a F c3 i (11.3.71) 


P denotes an arbitrary interior point at (21, 22,273) of a region R, and Q is any point on 
the boundary of R. Here c;, C;, and K; are functions of x1, x2, and x3 only. 

Many years ago, Bartels and Churchill!+ extended Duhumel’s theorem to solve this heat 
conduction problem. They did this by first introducing the simpler initial-boundary-value 
problem: 


- = L(v) + f(P,tıi)  0«t, (11.3.72) 
B(v)-g(Q i, | 0«t (11.3.73) 

and 
v(P,0) =h(P), (11.3.74) 


14 Bartels, R. C. F., and R. V. Churchill, 1942: Resolution of boundary problems by the use of a 
generalized convolution. Am. Math. Soc. Bull., 48, 276—282. 
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which has a constant forcing and boundary conditions in place of the time-dependent ones. 
Here tı denotes an arbitrary but fired instant of time. Then Bartels and Churchill proved 
that the solution to the original problem is given by the convolution integral 


u(P,t) = & f «e: —T,T)dr . (11.3.75) 


To illustrate! this technique, let us solve 


Ou — E (S 2j . a? Q?(ru) 


at w por | r Ore? dames Ha sso HIS) 


subject to the boundary conditions u(a,t) = uoe **, u.(8,t) = 0, 0 < t, and the initial 
condition u(r,0) = uo, a <r < B. 
We begin by solving the alternative problem 


Ov 3 (2 2 x) a? O? (rv) 
-— E 


Ot T Or2 r Or >? r Or? ’ a<re< B, 0< t, (11.3.77) 


subject to the boundary conditions v(a, t, t) = uge-** , v, (B,t, t) = 0,0 < t, and the initial 
condition v(r,0, t) = uo, a < r < B, or equivalently 


Ow _ Pw  20wY  a?O?(rw) 
Ot — ðr? r Or) r ðr’ 


a<r<ß, 0<t, (11.3.78) 


subject to the boundary conditions w(a, t,t’) = 0, wr (8,t, t^) = 0, and the initial condition 
w(r,0,t^) = uo(1— et), a « r « B, where v(r,t, t) = uge t+ w(r, t,t’). 

The heat condition problem Equation 11.3.78 can be solved using separation of vari- 
ables. This yields 


w(r, t,t’) = aug(1 ene) »» ERIS i. Wes Sal) akt (11.3.79) 


where kn is the nth root of Bk = tan[k(6 —o))], and 2c, = {8 sin?[k, (8—0)] — o). Therefore, 


u(r,t) = M Lr + aug(l—e 4") p sinik Saher l sinka ol a5 Ern) d (11.3.80) 
+ ao Sail off le aka Qon) — ghe oem) $i ar} 1.3.81) 

= rue + au z mh e) $i z uS — | (11.3.82) 
=ruge ^ + acuo Y aee- oko dus il (11.3.83) 


15 See Reiss, H., and V. K. LaMer, 1950: Diffusional boundary value problems involving moving bound- 
aries, connected with the growth of colloidal particles. J. Chem. Phys., 18, 1-12. 
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and the final answer is 


—a?k?t ct 


oo EN 
= acug e * hate 
u(r,t) = uge ^ + J 
(r,#) g r£ (c— a? )knen 


sin[k,(r — o)]. (11.3.84) 


Problems 


1. The Sturm-Liouville problem y" + Ay = 0, y(0) = y(L) = 0 has the eigenfunction 
solution yn(x) = sin(nzz/L). Find the eigenfunction expansion for f(x) = x using this 
eigenfunction. 


2. The Sturm-Liouville problem y" + Ay = 0, y'(0) = y'(D) = 0 has the eigenfunction 
solutions yo(z) = 1, and y,(x) = cos(nzz/L). Find the eigenfunction expansion for f(x) = 
x using these eigenfunctions. 


3. The Sturm-Liouville problem y" + Ay = 0, y(0) = y'(L) = 0 has the eigenfunction 
solution yn (x) = sin|(2n — 1)rz/(2L)]. Find the eigenfunction expansion for f(x) = x using 
this eigenfunction. 


4. The Sturm-Liouville problem y" + Ay = 0, y'(0) = y(L) = 0 has the eigenfunction 
solution y,(x) = cos[(2n — 1)rz/(2L)]. Find the eigenfunction expansion for f(x) = x 
using this eigenfunction. 


5. Consider the eigenvalue problem 
y" -- (A — a?)y =0, D «cse T. 


with the boundary conditions y'(0) + ay(0) = 0 and y'(1) + ay(1) = 0. 
Step 1: Show that this is a regular Sturm-Liouville problem. 


Step 2: Show that the eigenvalues and eigenfunctions are ào = 0, yo(a) = e ?^* and 
An = à? + n?s?, y (x) = asin(nrx) — nr cos(nnz), where n = 1,2,3,.... 


Step 3: Given a function f(x), show that we can expand it as follows: 


f(x) = Coe ** + 5 Cn [asin(nzz) — nr cos(nza)] , 


n=l 


where 


1 
1—e79)0,—2 rye dx 
(1 — e724) Cy af f(z)e-** dz, 


and i 
(a? + n?2?)C,, = 2 | f(x) [asin(nzz) — nr cos(nz2)] da. 
0 


6. Consider the eigenvalue problem 


y" + Ay" — 0, agzi, 
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with the boundary conditions y(0) = y'(0) = y(1) = y'(1) = 0. Prove the following points: 
Step 1: Show that the eigenfunctions are 


1 — cos(kn) 


yn (x) —1- cos(k,a) + ken — sin(kn) 


[sin(k,x) — knz], 


where k,, denotes the nth root of sin(k/2)[sin(k/2) — (k/2) cos(k/2)] = 0. 


Step 2: Show that there are two classes of eigenfunctions: kn = 2n« with y,(x) = 1— 
cos(2n7x), and tan(&,/2) = &,/2 with y,(x) = 1 — cos(nx) + 2[sin(&,x) — &,x]/ ka. 


Step 3: Show that the orthogonality condition for this problem is 


1 
| yi (ayln(a)de=0, nm, 


where yn (x) and y, (x) are two distinct eigenfunction solutions of this problem. Hint: Follow 
the proof in Section 11.2 and integrate repeatedly by parts to eliminate higher derivative 
terms. 


Step 4: Show that we can construct an eigenfunction expansion for an arbitrary function 


f(x) via 


oo l p , 
d 
f(a) = 5 Cay (x); 0<x<1, provided Cn = h F(@)un(e) de 
= Ty GJ? ae 
What are the condition(s) on f(x)? 


Separation of Variables Solution to the Wave Equation 


7. The differential equation for the longitudinal vibrations of a rod within a viscous fluid is 


Pu Ou u 
tne Ba? 


0<a<L, 0<t, 


where c is the velocity of sound in the rod and h is the damping coefficient. If the rod is 
fixed at x = 0 so that u(0,t) = 0, and allowed to freely oscillate at the other end x = L, so 
that u(L,t) = 0, find the vibrations for any location x and subsequent time t if the rod has 
the initial displacement of u(x,0) = x and the initial velocity u,(z,0) = 0 for 0 < x < L. 
Assume that h < cx/(2L). Why? 


8. A closed pipe of length L contains air whose density is slightly greater than that of the 
outside air in the ratio of 1+ so to 1. Everything being at rest, we suddenly draw aside the 
disk closing one end of the pipe. We want to determine what happens inside the pipe after 
we remove the disk. 

As the air rushes outside, it generates sound waves within the pipe. The wave equation 


governs these waves, where c is the speed of sound and u(x,t) is the velocity potential. 
Without going into the fluid mechanics of the problem, the boundary conditions are 
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a. No flow through the closed end: u,(0,t) = 0. 

b. No infinite acceleration at the open end: u;4(L,t) = 0. 

c. Air is initially at rest: uz(z,0) = 0. 

d. Air initially has a density greater than the surrounding air by the amount so: u(x, 0) = 


2 
—C Sg. 
Find the velocity potential at all positions within the pipe and all subsequent times. 


Separation of Variables Solution to the Heat Equation 


For Problems 9-13, solve the heat equation u; = a?u,44, 0 < x < m, 0 < t, subject to the 
following boundary conditions and initial condition. Then plot your results using MATLAB. 


9. uz(0,t) = u(r, t) = 0, 0 < t; u(z,0 222— 7,0«m«m 

10. u(0,t) 20, uz(T,t) 20,0«t; u(z,0) =1,0<a<7 

11. u(0,t) 20, u4(7,0 20,0«t;u(z,0)— m, 0€«mr«m 

12. u(0,t) 20, u4(7,0 20,0«t;u(z,0)—5 *—z,0cm«m 

13. u(0,t) = To, u,(m,t) 20,0« t; u(z,0) =T, Z Tog, 0< £< T 

14. It is well known that a room with masonry walls is often very difficult to heat. Consider 
a wall of thickness L, conductivity &, and diffusivity a?, which we heat by a surface heat 
flux at a constant rate H. The temperature of the outside (out-of-doors) face of the wall 
remains constant at Tọ and the entire wall initially has the uniform temperature Tọ. Let us 
find the temperature of the inside face as a function of time.!8 


We begin by solving the heat conduction problem 


Ou | Pu 


u— 0 L, 0«t 
8t a ap «r«L, <t, 


subject to the boundary conditions that uz(0,t) = —H/k, u(L,t) = To, 0 < t, and the 
initial condition that u(z,0) = To, 0 < x < L. Show that the temperature field equals 


m HL r 8x 1 (2n — 1)nz (2n — 1)?z?a?t 
u(x,t) = To 4 = E L eaan 737 Jeo] ne : 


Therefore, the rise of temperature at the interior wall z = 0 is 
HL 8 Z 1 (2n — 1)?n?a?t 
1 
k { T? 2 (Qn — 1)2 ew AL? 


8HL — 1 (2n — 1)?n?a?t 
1 — exp j 
KT? (2n — 1)? AI? 


or 


16 See Dufton, A. F., 1927: The warming of walls. Philos. Mag., Ser. 7, 4, 888-889. 
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For a?t/ L? < 1, this last expression can be approximated!" by 2Hat!/?/ q1/?&, We thus 
see that the temperature will initially rise as the square root of time and diffusivity and 
inversely with conductivity. For an average rock, & = 0.0042 g/cm-s, and a? = 0.0118 
cm?/s, while for wood (spruce) & = 0.0003 g/cm-s, and a? = 0.0024 cm? /s. 

'The same set of equations applies to heat transfer within a transistor operating at low 
frequencies.!? At the junction (x = 0), heat is produced at the rate of H and flows to the 
transistor's supports (x = +L) where it is removed. The supports are maintained at the 
temperature 75, which is also the initial temperature of the transistor. 


15. We want to find the rise of the water table of an aquifer, which we sandwich between a 
canal and impervious rocks if we suddenly raise the water level in the canal ho units above 
its initial elevation and then maintain the canal at this level. The linearized Boussinesq 
equation 

Ou &u 

Ot Ox?’ 
governs the level of the water table with the boundary conditions u(0, t) = ho, and u,(L, t) = 
0, and the initial condition u(z,0) = 0. Find the height of the water table at any point in 
the aquifer and any time t > 0. 


O0<a<L, 0<t, 


16. Solve the nonhomogeneous heat equation 


— =e”, LELT Oct, 


subject to the boundary conditions u(0,t) = uz(7,t) = 0, 0 < t, and the initial condition 
u(r,0) = f(x), 0 € x « v. Hint: First find the steady-state solution w(x) and then write 
u(x,t) = w(x) + v(z,t), where v(z,t) is the transient solution so that u(x,t) satisfies the 
initial condition. 


17 Let us define the function: 


A^ 1 — exp[- (2n — 1)222a2t/L?] 
jos a l 
n=1 
Then 
a2 


us 5 exp[- (2n — 1)?z2a?t/ 12]. 


n=1 


2 ant , d L 
exp| — x g= . 
0 F L2 2a nt 
If we approximate this integral by using the trapezoidal rule with Ax = 2, then 
oe 2,2 = 
t 
^ se (- 7 2 da = 25 "exp[- (2n — 1)?z?2a?t/ L?], 

0 n=l 


and f'(t) © ax?/? /(ALtV/?). Integrating and using f(0) = 0, we finally have f(t) ~ an?/?t!/2/(2L). The 
smaller a?t/L? is, the smaller the error will be. For example, if t = L? /a?, then the error is 2.4%. 


f'(t- 


Consider now the integral 


18 Mortenson, K. E., 1957: Transistor junction temperature as a function of time. Proc. IRE, 45, 
504-513. Equation 2a should read Tz = —F/k. 
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17. Solve the nonhomogeneous heat equation 


A 
—a | 2. O0<a<L, 0<t, 
Ot Ox? cp 


where a? = &/cp, with the boundary conditions that u,(0,t) = 0, kuz(L, t) + hu(L,t) = 0, 
0 < t, and the initial condition that u(z,0) = 0,0 < x < L. Hint: First find the steady-state 
solution w(x) and then write u(x,t) = w(x) + v(z, t), where v(x, t) is the transient solution 
so that u(x,t) satisfies the initial condition. 


18. Solve!? 
Ou "n o?u 
— + ku = 25 
ðt Oa?” 
with the boundary conditions uz(0,t) = 0, a?us (L, t) + kau(L,t) = 0, 0 < t, and the initial 
condition u(x, 0) = uo, 0< x < L. 


Oe bs VE 


19. Solve 5 à E 
u u 2.0 1 
p | 0 p. 0<t, 
dt Or ^ Or? UM E 
with the boundary conditions a?u,(0,t) = u(0,t), u,(1,t) = 0, 0 < t, and the initial 
condition u(z,0) — 1, 0 « z « 1. Hint: Let u(x,t) = v(z,t) exp((2x — t)/(4a?)] so that the 
problem becomes 


av ae 

Ot "^ Bg 
with the boundary conditions 2a?v,(0,t) = v(0, t), 2a?v,(1,t) = —v(1,t), 0 < t, and the 
initial condition v(z, 0) = exp[-2/(2a?)], 0 « x « 1. 


0cr«l, 0<t, 


20. Solve the heat equation in spherical coordinates 


Ot | r?Ór 


2 2 92 
ps E (n) oo a «r «f, 0 « t, 


subject to the boundary conditions u(a,t) = u.(8,t) = 0, 0 < t, and the initial condition 
u(r,0) 2 ug, o <r « B. 


21. Solve?? the heat equation in spherical coordinates 


Ou 2 ?u 20u a? 9? (ru) 
Ot a (5: 23 r ðZ? O0<r<b, 0<t, 


subject to the boundary conditions lim,_,9 Ur (r,t) + 0, ur(b,t) = —Au(b,t)/b, 0 < t, and 
the initial condition u(r,0) = uo, 0 € r < b. Hint: Introduce the dependent variable 
v(r,t)=ru(r,t). 


19 Motivated by problems solved in Gomer, R., 1951: Wall reactions and diffusion in static and flow 
systems. J. Chem. Phys., 19, 284-289. 


20 Zhou, H., S. Abanades, G. Flamant, D. Gauthier, and J. Lu, 2002: Simulation of heavy metal vapor- 
ization dynamics of a fluidized bed. Chem. Eng. Sci., 57, 2603-2614. See also Mantell, C., M. Rodriguez, 
and E. Martinez de la Ossa, 2002: Semi-batch extraction of anthocyanins from red grape pomace in packed 
beds: Experimental results and process modelling. Chem. Eng. Sci., 57, 3831-3838. 
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22. Use separation of variables to solve?! the partial differential equation 


= + 2a 0cz«l, 0<t, 


subject to the boundary conditions that u,(0,t) + 2au(0,t) = 0, uz(1,t) + 2au(1,t) = 0, 
0 « t, and the initial condition that u(x,0)=1,0< x « 1. 


Step 1: Introducing u(x,t) = e **v(xz,t), show that the problem becomes 


LA cu U, O0<a<l, Oct, 


subject to the boundary conditions that v, (0, t) + av(0,t) = 0, v, (1, t) + av(1,t) — 0, 0 <t, 
and the initial condition that u(x,0) = e°, 0 « x « 1. 


Step 2: Assuming that v(z,t) = X(x)T(t), show that the problem reduces to the ordinary 
differential equations 


X" + (A— a?)X — 0, X'(0)+aX(0)=0, X’(1) +aX(1) =0, 


and T" + AT = 0, where A is the separation constant. 


Step 3: Solve the eigenvalue problem and show that Ap = 0, Xo(a) = e7%, To(t) = Ao, 
and A, = a? +n?x?, X, (v) = asin(nza) — nz cos(nza), and T,(t) = Anew +*)#, where 
n —1,2,3,..., so that 


u(x,t) = Age ^* + 5 An [a sin(nzax) — nr cos(nzz)] grae E 


n=1 
Step 4: Evaluate Ap and A, and show that 


Jae 9 e". n[I — (—1)"e*] 


—az-— (a? --n?2?)t 
(a? +4 n?2?)? 


[a sin(nzz) — nr cos(nzzx)| e 


n=1 


23. Use separation of variables to solve?? the partial differential equation 
q 


Pu O*u 


Bet0t Oat? 0<a<il, 0 « t, 


subject to the boundary conditions that u(0,t) = u4(0,t) = u(1,t) = u,(1,t) = 0, 0 < t, 
and the initial condition that u(z,0) = Az/2— (1— A)z?(—2),0€ z € 1. 

Step 1: Assuming that u(x,t) = X(x)T(t), show that the problem reduces to the ordinary 
differential equations X'' + k? X" = 0, X(0) = X'(0) = X(1) = X'(1) = 0, and T'+k°T = 
0, where k? is the separation constant. 


21 See DeGroot, S. R., 1942: Théorie phénoménologique de l'effet Soret. Physica, 9, 699—707. 


?2 See Hamza, E. A., 1999: Impulsive squeezing with suction and injection. J. Appl. Mech., 66, 945-951. 
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Step 2: Solving the eigenvalue problem first, show that 


1 — cos(kn) 


XQ (x) —1-— cos(k,a) + ken — sin(kn) 


[sin(k,z) — knz], 


where kn denotes the nth root of sin(k/2)[sin(k/2) — (k/2) cos(k/2)] = 


Step 3: Using the results from Step 2, show that there are two classes of eigenfunctions: 
kn = 2nm, X4(r) = 1 — cos(2nzr), and tan(&,/2) = Kn/2, X4(x) = 1 — cos(&,x) + 
2[sin(&,x) — &4x]/ 5. 


Step 4: Consider the eigenvalue problem 


X" + AX" — 0, 0«czr«l, 


with the boundary conditions X(0) = X'(0) = X(1) = X'(1) 2 0. Show that the orthogo- 
nality condition for this problem is 


1 
| X, (2) X, (x) da = 0, nzm, 


where X4(r) and X,,(x) are two distinct eigenfunctions of this problem. Then show that 
we can construct an eigenfunction expansion for an arbitrary function f(x) via 


[a x) dx 
Toe s E dx 


E 5 C, X4 (x), provided [Qu 


and f'(x) exists over the interval (0, 1). Hint: Follow the proof in Section 11.2 and integrate 
repeatedly by parts to eliminate the higher derivative terms. 


Step 5: Show that 
1 
n [X7 (a)? dz = 2n?s?, 
0 


if Xn (x) = 1 — cos(2nzx), and 


li XA GO de = 2/2, 


0 
if X4(z) = 1 — cos(&,x) + 2[sin(&;z) — &,z]/&,. Hint: sin(kn) = &&[1 + cos(&)]/2. 
Step 6: Use the above results to show that 


ijo > A«[1 — cos(2nza)]e- 4" 7! 
n=1 


2 
+ D B, E — cos(&,x) — z Isin(&aa) — zi e", 


TL 


where A, is the Fourier coefficient corresponding to the eigenfunction 1 — cos(2n7a) while 
B, is the Fourier coefficient corresponding to the eigenfunction 1 — cos(&,z) — 2|sin(«,x) — 
Knt|/Kn. 
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Step 7: Show that A, = 0 and B, = 2(1 — A)/&2, so that 


TL 


ust) = 20 — 4) (1.7 costa) - 2 inna) — nna] Y 


n=1 


Hint: sin(kn) = &,[14- cos(&,)]/2, sin(Kn) = 2[1—cos(Kn)]/Kn, and cos(kn) = (4—&2)/(44- 
Ke’, 


24. Solve the heat equation 


ðu Ou 
— = — 0 1, O<t 
8t EL «rc«l1, « t, 


subject to the boundary conditions u(0,t) = f(t), uz(1,t) = —hu(1,t), 0 < t, and the initial 
condition u(z,0) — 0, 0 « x « 1. 
Step 1: First solve the heat conduction problem 


EN a O0<a<l, 0<t 

at Ox?’ ux 

subject to the boundary conditions A(0,t) = 1, A,(1,t) = —AA(1,t), 0 < t, and the initial 
condition A(x,0) = 0, 0 < x < 1. Show that 


ha 2 k2 +h? 2 
A(r,t) 21 2 n in(k,z)e "^! 
(x,t) Ith 22k ERR) sin(k,r)e "^", 


where kn is the nth root of kcot(k) = —h. 


Step 2: Use Duhamel's theorem and show that 


(k2 + n?) x2 
wast) = 2D Fe alba en fn e^? dr. 


Separation of Variables Solution to Laplace’s Equation 


Solve Laplace's equation Uzr + Uyy = 0 over the rectangular region 0 < x «a, 0«y «b 
with the following boundary conditions. Illustrate your solution using MATLAB. 


25. u,(0,y) = u(a,y) = u(z,0) = 0, u(z,b) = 1 
26. u,(z,0) = u(z, 0) = u(a, y) = 0, u(0,y) = 1 


0,y) = u(z,0) = 1 Hint: Let u(z,y) = v(z, y) + w(z,y) 
) — 0, e(5,0) — 1 and «w(z, 0) = wy(2,B) = wola,y) = 0, 
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11.4 FINITE ELEMENT METHOD 


In Section 1.7 we showed how to solve ordinary differential equations using finite differ- 
ences. Here we introduce a popular alternative, the finite element method, and will use it 
to solve the Sturm-Liouville problem. One advantage of this approach is that we can focus 
on the details of the numerical scheme. 

The finite element method breaks the global solution domain into a number of simply 
shaped subdomains, called elements. The global solution is then constructed by assembling 
the results from all of the elements. A particular strength of this method is that the 
elements do not have to be the same size; this allows us to have more resolution in regions 
where the solution is rapidly changing and fewer elements where the solution changes slowly. 
Overall, the solution of the ordinary differential equation is given by a succession of piecewise 
continuous functions. 

Consider the Sturm-Liouville problem 


E (a) A + q(z)y(x) — Ar(x)y(x) = 0, a«z«b, (11.4.1) 

with 
y(a) — 0, or p(a)y'(a) = 0, (11.4.2) 

nd 
i y(b) = 0, or p(b)y'(b) = 0. (11.4.3) 


Our formulation of the finite element approximation to the exact solution is called the 
Galerkin weighted residual approach. This is not the only possible way of formulating the 
finite element equations, but it is similar to the eigenfunction expansions that we highlighted 
in this chapter. Our approach consists of two steps: First we assume that y(x) can be 
expressed over a particular element by 


J 
ule) = Y vosle), (11.4.4) 


where o;(x) is the jth approximation or shape function, and J is the total number of 
elements. 
Let us define the residue 


R(z) = Lr z] ENNEN: (11.4.5) 


dx dx 


We now require that for each element along the segment Qe = (£n, 2544), 


f R(x)pi(x) dx = 0, 12.152,39, 5.44. (11.4.6) 
Q 


e 


The points £n and x41 are known as nodes. Substituting Equation 11.4.5 into Equation 
11.4.6, 


f Ux Lord + a(x)y(a) — vov) yi(x) dz = 0. (11.4.7) 


e 


Because 


z 2 E [ora pi(x) dx = —p(x) 7 pila) 


dx dz 


vert Tuer dy d d 
«f ps) Yi ae, (11.4.8) 


n n 
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then 


Tn+1 


dx 


je |o em + q(z)y(z)o;(z) — (ours dx = p(x) = 


dy 
deo) 
Ln 
(11.4.9) 
Upon using Equation 11.4.4 to eliminate y(x) and reversing the order of summation 


and integration, our second step in the finite element method involves solving for y; via 


Xe (ZE de 2 acs f q(x) pi(x)p; (x) dx 


n 


Ln+1 dy Tn+1 
-a [T reete dehy; Ee . aaao 
or using matrix notation 
Ky — AMy = b, (11.4.11) 
where 
Ki Ki? Kij My, Mie Mj 
Ko, Kə Koy Mo, Mo. ... May 
K= , M=| . S EU (11.4.12) 
Kj Kz Kjj Mn My» Mj; 
by yi 
b Y2 
EM |e ial (11.4.13) 
by Ys 
bi = p(£n41)y' (@n41) Pi(Ln41) — P(n)Yy' (Ln) Pi(Hn), (11.4.14) 
En+1 wi dy En+1 
Ky= fey FO) a «T. a(x)pilx)p;(2) de, (11.4.15) 
and 


M; = / E (11.4.16) 


Why do we prefer to use Equation 11.4.10 rather than Equation 11.4.7? There are 
two reasons. First, it offers a convenient method for introducing the specified boundary 
conditions, Equation 11.4.2 and Equation 11.4.3. Second, it has lowered the highest-order 
derivatives from a second to a first derivative. This yields the significant benefit that p;(x) 
must only be continuous but not necessarily a continuous slope at the nodes. 

An important question is how we will evaluate the integrals in Equation 11.4.15 and 
Equation 11.4.16. Because p(x), q(x), and r(x) are known, we could substitute these quan- 
tities along with y;(x) and o;(x) into Equation 11.4.15 and Equation 11.4.16 and perform 
the integration, presumably numerically. In a similar vein, we could develop curve fits for 
p(x), g(x), and r(x) and again perform the integrations. However, we simply use their 
values at the midpoint between the nodes, £n = (x4441 + 25)/2, because p(x), q(x) and r(x) 
usually vary slowly over the interval (£n, x, 41). 

At this point we will specify J. The simplest case is J = 2 and we have the linear 


element: 


X — Tı T2 — T 


and p2lx) = (11.4.17) 


Puce c T2 — T1’ 
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Table 11.4.1: The System Topology for 4 Finite-Element Segmentations When a Linear 
Interpolation Is Used 


Node Numbers 


Element Local Global 
1 1 1 
2 2 
2 1 2 
2 3 
3 1 3 
2 4 
4 1 4 
2 5 


where x; and £2 are local nodal points located at the end of the element. It directly follows 
that 
dy dpi de2 — ya—u 
de up uo z2 — 21 


(11.4.18) 


In other words, dy/dx equals the slope of the straight line connecting the nodes. Similarly, 


i y(x) dx = 5 (ya + y1) (xa — 21) (11.4.19) 


1 


and we simply have the trapezoidal rule. 


Substituting yi(2) and y2(x) into Equation 11.4.15 and Equation 11.4.16 and carrying 
out the integration, we obtain 


Te Ze)L Le Ze)L 
Ku ) pa ) » Ky2= P(e) 4 ) » Ka =K, and Kz = Kı, 
L 3 L 6 
(11.4.20) 
with L = z» — xı and ze = (£1 + 22)/2. Similarly, 
c)L aM 
Mı = i = Mə, and Mi= ro = M. (11.4.21) 


Finally, because q1(z1) = 0, pı(x2) = 1, 2(z1) = 1, and ¢2(r2) = 0, bı = —p(zi)y (x1) 
and b2 = p(za)yo(x2). 

Having obtained the finite element representation for nodes 1 and 2, we would like to 
extend these results to an arbitrary number of additional nodes. This is done by setting up 
a look-up table that relates the global nodal points to the local ones. For example, suppose 
we would like 5 nodes between a and b with xz = 21, £2, £3, £4, and x5. Then Table 11.4.1 
illustrates our look-up table. 

Having developed the spatial layout, we are now ready to assemble the matrix for the 
entire interval (a, b). For clarity we will give the intermediate steps. Taking the first element 
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into account, 


KP KË 000 M) MS 000 
KS) KY) 000 M) MY 0 0 0 
K=] 0 0 000|, M=] 0 0 0 0 0], (11422) 
0 0 000 0 0 000 
0 0 000 0 0 000 
—p zı) '(x1) yi 
p(z2)y'(z2) yo 
b= 0 , and y=] 0 |. (11.4.23) 
0 0 
0 0 


Here we have added a subscript (1) to K;; and Mi; to denote that value for the first element 
should be used in computing p(z«), q(a-), r(z.), and L. Consequently, when we introduce 
the second element, K, M, and y become 


KY KY 0 0 0 
1 1 2 2 
K—| 9 KË KË 0 of: (11.4.24) 
0 0 0 00 
0 0 0 0 0 
ME MQ 0 00 
1 1 2 2 
M-| 9 M M9 oo[ (11.4.25) 
0 0 0 00 
0 0 0 00 
—p(zi)y (x1) Ui 
0 ya 
b=] r»(zs)y(zs) |, and y=] ys |. (11.4.26) 
0 0 
0 0 


Note that the numbering for y; corresponds to ith global node number. Continuing with 
this process of adding additional elements to the system matrix, we finally have 


KY KY 0 0 0 
1 1 2 2 
Ky) K+K KY? 0 0 
AK o0 KY KË x9 ke 0 |, (11.4.27) 
3 3 4 4 
0 0 Ki — Ky + Ky) KG 
0 0 0 KY KY) 
Mi) M 0 0 0 
MP MPMP MË E 
u-| o  wP ^ Pew? m o [. aaa) 
0 0 Me MO +MP MË 
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Table 11.4.2: The Lowest Eigenvalue for Equation 11.4.30, Which Is Solved Using a Finite 
Element Method 


L A 
0.250 10.6745 
0.100 10.2335 
0.050 10.1717 
0.020 10.1544 
0.010 10.1520 
0.002 10.1512 
where 
—p(zi)v' (x1) Yı 
0 Y2 
b= 0 , and y=] ys]. (11.4.29) 
0 UA 
p(zs)y' (vs) UE 


Let us examine the b vector more closely. In the final form of the finite element formu- 
lation, b has non-zero values only at the end points; the contributions from intermediate 
nodal points vanish because p(x)y'(x) is continuous within the interval (a,b). Furthermore, 
if y'(a) = y'(b) = 0 from the boundary conditions, then the b vector becomes the zero 
vector. On the other hand, if y(a) = y(b) = 0, then yı = ys = 0 and the eigenvalue problem 
involves a 3 x 3 matrix with the unknowns yo, y3, and y4. Similarly, if y'(a) = y(b) = 0, 
then we have a 4 x 4 matrix with the unknowns yi, yo, ya, Y4, and ys = 0. Finally, if 
y(a) = y'(b) = 0, we again have a 4 x 4 matrix involving yı = 0 and the unknowns yo, ys, 
ya, and ys. 

To illustrate this scheme, consider the Sturm-Liouville problem 


y+A-2*)y=0, OK<ar<l (11.4.30) 


with y(0) = y(1) = 0. Here p(x) = 1, q(x) = 2”, and r(x) = 1. 

The MATLAB code begins with the choice of the number of elements, N. Once that is 
done, L immediately follows because L = 1/(N-1). We will also need to have the value of 
x at the node points x(n) = L*(n-1) where n = 1:N. 

With these preliminaries out of the way, we begin by setting up the matrices K and 
M given by Equation 11.4.27 and Equation 11.4.28. The corresponding MATLAB code is: 
for i - 1:N-1 

xc = O.5*(x(i) + x(i*1)); 

p = 1; q = x-c*x_c; r = 1; 

K11 = p/L + q*L/3; K22 = K 11; 
K-12 = -p/L + q*L/6; K-21 = K 12; 
M-11 = r*L/3; M-22 = M.11; 

M12 = r*L/6; M_21 = M.12; 
KK(i,i)-KK(i,i)-*Kl11; 
KK( i ,i*1) = KK( i ,i+1) + K 12; 
KK(iti, i) = KK(i+1, i) + K21; 
KK(i+1,i+1) = KK(i*i,i-1) + K_22; 
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02 04 06 0.8 1 
x 

Figure 11.4.1: Numerical solution of y" + 2y' + y = 2r + 3sin(x) with y'(0) = —2 and y'(1) = 3 using 

finite elements with Az = 0.1. The crosses indicate the exact solution. 


MMC i, i) = MMC i ,i) + M411; 

MMC i ,i+1) = MMC i ,i*1) + M12; 

MM(i+1, i ) = MM(i+1, i) + M21; 

MM(it1,i+1) = MM(i+1,i+1) + M_22; 
end 


Note that the arrays KK and MM have already been defined as N x N arrays with all of their 
elements set to zero. 
Finally, because y; and yy are zero, we must extract that portion of K and M for 

which ym #0. This is done as follows: 
for j = 1:N-2 
for i = 1:N-2 

ACi,j) = KK(G*1,j*1); 

B(i,j) = MM(it1,j+1); 


end; end 
Finally, the eigenvalues are found by eig(A,B). If the corresponding eigenfunction is 
desired, then the corresponding eigenfunction gives y; for j = 2,3,..., N—1 using Equation 


11.4.4. Table 11.4.2 illustrates how the lowest eigenvalue for Equation 11.4.30 improves in 
accuracy as the number of nodes is increased. 


Project: Finite Element Solution of Boundary-Value Problems 


In addition to solving the Sturm-Liouville problem, finite element methods can be used 
to solve the standard boundary-value problem: 


-E [ror E| tewo  0< 0 <1, 


where we specify y(0) or y'(0) at x = 0 and y(1) or y'(1) at x = 1. Although you could 
create your MATLAB code to solve this problem, MATLAB code has already been developed 
and is available online.?? The purpose of this project is for you to become comfortable using 
this scheme. 


23 For example, http://people.sc.fsu.edu/~burkardt/m_src/femid/femid.html 
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Table 11.4.3: The Eigenvalues for the Sturm-Liouville Problem Stated in Example 11.1.1 


Using the Finite Element Method for Various N’s. The Boldface Digits Are Those that 
Differ from the Exact Answer. 


—0.96197352 
1.75605999 
6.69690282 

15.81967372 

26.80475760 


—0.98441038 
1.68721832 
5.89559315 

12.76377241 

22.90921756 

37.11271111 

55.95775087 

78.82277983 

102.01056615 
117.83174892 


—0.99108552 
1.66802975 
5.67320930 

11.80121128 

20.13008890 

30.78756638 

43.93943526 

59.78883650 

78.57612764 

100.57733062 
126.09956238 


—0.99205427 
1.66529435 
5.64181953 

11.66700268 

19.74581245 

29.90669715 

42.18874880 

57.64002877 

73.31730755 

92.28610692 

113.62082677 


exact 


—0.99237804 
1.66438291 
5.63138040 

11.62250178 
19.61888190 
29.61705752 
41.61601074 
55.61535492 
71.61491703 
89.61461020 
109.61438688 


Step 1: Using the method of undetermined coefficients, solve the boundary-value problem 


y” +2y' +y = 2r +3sin(x), — y(0-—-2, y(1)-3. 


Show that 


y(x) = 2x — 4 — 3 cos(x) + 1 [3sin(1) — 2] e * + 1 [3sin(1) — 2 — 8/e] ve! *. 


Step 2: Show that the ordinary differential equation can be written as 


d 


dy 
2x 22, — 2x 22 3° / — / NE 
dz (: w) +ey = 2re + 3e” sin(x), y (0) 2, y'(1)-3. 


Step 3: Find the numerical solution of the boundary-value problem using finite elements. 
Figure 11.4.1 illustrates the solution. 


Project: Robin Boundary Condition?! 


In this section we showed how to find the eigenvalues and eigenfunctions for a Sturm- 
Liouville problem using finite element methods when we have Dirichlet and/or Neumann 
conditions. What do we do when we have a Robin boundary condition at one or both ends? 
Answering that question is the goal of this project. 


24 Suggested by Akano, T. T., and O. A. Fakinlede, 2015: Numerical computation of Sturm-Liouville 
problem with Robin boundary condition. Int. J. Math. Comput. Sci., 9, 690—694. 
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'The difficulty here is that the vector b is not equal to zero. However, from Equation 
11.1.2 we have y'(a) = —ay(a)/8 and y'(b) = —yy(b)/ð provided 8 and 6 are nonzero. In 
this case we can rewrite b as 


op(z1)y(z1)/B 
0 
b= 0 = Gijy, 
0 
—yp(zs)y(xs)/¥ 
where 
op(z1)/ B, t=j=1 
Gij = 4 —yp(xs5)/ð, i=j=5 
0, otherwise. 


We can then combine G;; with Kij and then numerically solve the resulting classic eigenvalue 
problem. 

Using the code that we developed to solve Equation 11.4.20, use the finite element 
technique to find the eigenvalues for Example 11.1.1. In this case we still have yı = 0 but 
UN = yn. Table 11.4.2 shows some of the numerical results at different resolutions. 


Further Readings 


Akulenko, L. D., and S. V. Nesterov, 2004: High-Precision Methods in Eigenvalue Problems. 
CRC Press, 260 pp. A fairly new book on analytic, asymptotic and numerical methods in 
solving the Sturm-Liouville problem. 


Clarlet, P. G., 1978: The Finite Element Method for Elliptic Problems. Elsevier North- 
Holland, 530 pp. The classic text on finite element methods. 


Titchmarsh, E. C., 1946: Eigenfunction Expansions Associated with Second Order Differen- 
tial Equations. Camp Press, 188 pp. A rigorous treatment of the Sturm-Liouville problem. 


Chapter 12 
Special Functions 


In the previous chapter we studied how boundary-value problems of the form: 


d 


EAR ases (1201 


dx 


along with the boundary conditions: 
ay(a) + By'(a)=0 and — sy(0) + dy/(b) = 0, (12.0.2) 


the so-called Sturm-Liouville problem, could be used to re-express a continuous function 
f(x) in terms of discrete solution to Equation 12.0.1. There we required that the real 
function p(x) and r(x) be continuous and positive on the interval a € x < b. In this chapter 
we consider the problem when p(a) and/or p(b) equal zero. 

Let y, (z) and yj, (x) denote the eigenfunctions associated with two different eigenvalues 
An and Am. Then 


- Lord + [a(z) + Aur(x)]us (x) = 0, (12.0.3) 
£ (a) | + [a(z)  Amr(z)]ym (2) = 0. (12.0.4) 


Let us multiply the first differential equation by ym; the second by yn. Next, we subtract 
these two equations and move the terms containing YnYm to the right side, resulting in 


d 
zn dx 


a) — tn p | = On — Aram. (12.0.5) 


493 


494 Advanced Engineering Mathematics with MATLAB 


Integrating Equation 12.0.5 from a to b yields 


[ Tr. I Lr r3 Ym L Lr ze] \ dz = (An — Am) T r(£)ynymdz. (12.0.6) 


We can simplify the left side of Equation 12.0.6 by integrating by parts to give 


1 Son E ote] - mae poe] yar 
b 


E E aue. / py. — vow] dx. (12.0.7) 


a 


The second integral equals zero since the integrand vanishes identically. Combining Equa- 
tion 12.0.6 and Equation 12.0.7 together, we find 


b 
(An — Am) / r(£)yntm d =[p(b)yn (b) (b) — (0), (9). (b) 
— s(a)yl, laya (a) + p(a)u/, (ajum (2) (12.0.8) 


From Equation 12.0.8 the right side vanishes and we preserve orthogonality (1) if y, (x) is 
finite and p(z)y/, (x) tends to zero at both endpoints (as in the case of Legendre polynomials 
in Section 12.1) or (2) if y(a) is finite, p(z)y, (x) > 0 as x > a, and y(x) satisfies Equation 
12.0.2 at x = b (as in the case of Bessel functions in Section 12.2). In this chapter we 
present two cases of these singular Sturm-Liouville problems and how to form expansions 
using the corresponding eigenfunctions. 


e Example 12.0.1 
Consider the zeroth-order Bessel equation: 
zy +y'+way=0, OXz«L. (12.0.9) 


(Equation 12.2.1 with n = 0.) Here a = 0, b= L, p(x) = v, r(x) = x and A = p?. Because 
p(0) — 0, this is an example of a singular Sturm-Liouville problem. 

In Section 12.2 we will show that Equation 12.0.9 has two linearly independent solu- 
tions: y1(x) = Jo(ux) and yo(x) = Yo(ux). Can we use either of these in an eigenfunction 
expansion? To do so, it must satisfy an orthogonality condition. Therefore, a solution must 
satisfy the criteria stated above. From Equation 12.2.10 and Equation 12.2.12, we find that 


2,3 Pot 
yi(x) = Jo(ue) =1- 25 +, na) --L te, (12.0.10) 
and 5 5 
22] DV Ao « g = —++... 12.0.11 
ya(z) = z In(ua/2)+---, — wYm)— — ts (12.0.11) 
for small x. Hence, 
lim yi(x) > 1, lim z yi (x) + 0, (12.0.12) 
1—0 r—0 


and j 
lim y2(x) > —oo, lim x yo(x) > —. (12.0.13) 
xz—>0 x20 T 
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Born into an affluent family, Adrien-Marie Legendre's (1752-1833) modest family fortune was suf- 
ficient to allow him to devote his life to research in celestial mechanics, number theory, and the 
theory of elliptic functions. In July 1784 he read before the Académie des sciences his Recherches 
sur la figure des planétes. It is in this paper that Legendre polynomials first appeared. (Portrait 
courtesy of the Archives de l'Académie des sciences, Paris.) 


Clearly only yi(x) satisfies the criteria and we must discard yo(x) from further discussion. 

Turning to the other endpoint x = L, yi(x) must satisfy yy1(L) + óyj(L) = 0, where 
either y or ó is nonzero. In Section 12.2 we will show that yı (x) also satisfies this condition 
if yi(x) = Jo(ugz), where up is the kth zero of hJo(uL) + nJ5(uL) = 0 and 0 < h < oo. 


12.1 LEGENDRE'S POLYNOMIALS 


Consider now Legendre's equation: 


d'y dy 
2 | I — 
(1— 2°) 3 203, t n(n * Dy — 0, (12.1.1) 
Or 
d d 
dx [a A P ERO, (12.1.2) 


where we set a = —1, b = 1, A = n(n + 1), p(x) = 1 — z?, q(x) = 0, and r(x) = 1. This 
equation arises in the solution of partial differential equations involving spherical geometry. 
Because p(—1) = p(1) = 0, we are faced with a singular Sturm-Liouville problem. However, 
as Equation 12.0.8 shows, orthogonality is preserved here. 
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Equation 12.1.1 does not have a simple general solution. [If n = 0, then y(x) = lisa 
solution.] Consequently we try to solve it with the power series: 


y(x) = DD Aps, y'(£)= 5 kAyz^" 1, and yw'(z)— 5 k(k—1)Aga*-?. (12.1.3) 
k=0 k=0 k=0 


Substituting into Equation 12.1.1, 


S k(k — 1) Ayz^? + Y [n(n + 1) — 2k — k(k — 1)] Axa = 0, (12.1.4) 


5 m(m — 1)Aqíaz" ? + 5 [n(n -- 1) — k(k + 1)] Aux^ = 0. (12.1.5) 
If we define k — m — 2 in the first summation, then 


Yu + 2)(k + 1) Apsoar® + $ [n(n + 1) — k(k + 1)] Apa" =0. (12.1.6) 
k=0 k=0 


Because Equation 12.1.6 must be true for any z, each power of x must vanish separately. 
It then follows that 


(k 4- 2)(k + 1) Ag42 = [k(k + 1) — n(n + 1) As, (12.1.7) 


[k(k +1) — n(n + 1)] 
(k + 1)(k + 2) 


where k = 0,1,2,.... Note that we still have the two arbitrary constants Ag and A, that 
are necessary for the general solution of Equation 12.1.1. 
The first few terms of the solution associated with Ag are 


Agy2 = Ar, (12.1.8) 


Up(x) = 1 mnt b ng Dr 1)(n +3) xt 


n(n — 2)(n — 4)(n + 1)(n - 3)(n +5) 6 


hoteles (n= D)(n +2) 3 | x 


ge (12.1.10) 


If n is an even positive integer (including n — 0), then the series, Equation 12.1.9, terminates 
with the term involving x”: The solution is a polynomial of degree n. Similarly, if n is an 
odd integer, the series, Equation 12.1.10, terminates with the term involving z". Otherwise, 
for n noninteger the expressions are infinite series. 
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Table 12.1.1: The First Ten Legendre Polynomials 


P3(x) = 4 (5x — 3x) 
P,(x) = (35x4 — 302? + 3) 
P5(x) = ¿(63x5 — 70x + 152) 


P(x) = 4 (23129 — 315z* + 1052? — 5) 


Pr(x) = 45 (429x* — 69325 + 31523 — 352) 


P(x) = xls (643525 — 120122 + 693024 — 12602? + 35) 


Po(x) = 75g (121552? — 25740x" + 18018x? — 46202? + 3152) 


Pio(a) = 515 (46189a!° — 10939528 + 9009049 — 3003024 + 34652? — 63) 


For reasons that will become apparent, we restrict ourselves to positive integers n. 
Actually, this includes all possible integers because the negative integer —n — 1 has the 
same Legendre’s equation and solution as the positive integer n. These polynomials are 
Legendre polynomials! and we may compute them by the power series: 


ay 
& 
l 


T (2n — 2k)! "m 
» D" kin — Es — 28917 ^ (12.1.11) 


where m — n/2, or m — (n — 1)/2, depending upon which is an integer. We chose to use 
Equation 12.1.11 over Equation 12.1.9 or Equation 12.1.10 because Equation 12.1.11 has 
the advantage that P,(1) = 1. Table 12.1.1 gives the first ten Legendre polynomials. 

'The other solution, the infinite series, is the Legendre function of the second kind, 
Q,(x). Figure 12.1.1 illustrates the first four Legendre polynomials P,(x) while Figure 
12.1.2 gives the first four Legendre functions of the second kind Q, (x). From this figure we 
see that Q,(r) becomes infinite at the points x = +1. As shown earlier, this is important 
because we are only interested in solutions to Legendre's equation that are finite over the 
interval [21,1]. On the other hand, in problems where we exclude the points x = +1, 
Legendre functions of the second kind will appear in the general solution.? 

In the case that n is not an integer, we can construct a solution? that remains finite 
at x = 1 but not at r = —1. Furthermore, we can construct a solution that is finite at 


1 Legendre, A. M., 1785: Sur l'attraction des sphéroides homogénes. Mém. math. phys. présentés à 
l'Acad. sci. pars divers savants, 10, 411—434. The best reference on Legendre polynomials is Hobson, E. 
W., 1965: The Theory of Spherical and Ellipsoidal Harmonics. Chelsea Publishing Co., 500 pp. 


? See Smythe, W. R., 1950: Static and Dynamic Electricity. McGraw-Hill, Section 5.215, for an example. 


3 See Carrier, G. F., M. Krook, and C. E. Pearson, 1966: Functions of the Complex Variable: Theory 
and Technique. McGraw-Hill, pp. 212-213. 
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Figure 12.1.1: The first four Legendre functions of the first kind. 


x = —] but not at x = 1. Because our solutions must be finite at both endpoints so that 
we can use them in an eigenfunction expansion, we must reject these solutions from further 
consideration and are left only with Legendre polynomials. From now on, we will only 
consider the properties and uses of these polynomials. 

Although we have the series, Equation 12.1.11, to compute P,(x), there are several 
alternative methods. We obtain the first method, known as Rodrigues’s formula, ^ by writing 
Equation 12.1.11 in the form 


le n!  (2n— 2k)! nak 
Pr (a) = 1 pe 12.1.12 
1 d" x k n! 2n—2k 
— 2n! da^ > 1) kl(n — ky . (12.1.13) 


The last summation is the binomial expansion of (z? — 1)" so that 


(z? — 1)”. (12.1.14) 


Another method for computing P,,(x) involves the use of recurrence formulas. The first 
step in finding these formulas is to establish the fact that 


(1 +h? — 2h) 1/7? = Po(x) + hP, (a) +h? Po(x) +---. (12.1.15) 


The function (1 + h? — 2xh)-V/? is the generating function for P,(x). We obtain the 
expansion via the formal binomial expansion 


(1+ h? — 2xh) 17? = 14 l(Qgzh — h?) 4233 (22h — R) H. (12.1.16) 


^ Rodrigues, O., 1816: Mémoire sur l'attraction des sphéroides. Correspond. l'École Polytech., 3, 
361—385. 
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Figure 12.1.2: The first four Legendre functions of the second kind. 
Upon expanding the terms contained in 2x — h? and grouping like powers of h, 
(1-- h? — 2xh) V? — 14 sh + (32? — D)? +---. (12.1.17) 


A direct comparison between the coefficients of each power of h and the Legendre polynomial 
P,,(a) completes the demonstration. Note that these results hold only if |x| and |A| < 1. 

Next we define W(a,h) = (1 + h? — 2zh)-!/?. A quick check shows that W (a, h) 
satisfies the first-order partial differential equation 


(1— 2zh + mE +(h-x)W =0. (12.1.18) 


The substitution of Equation 12.1.15 into Equation 12.1.18 yields 
(1— 2zh +h?) V ^ nP,(z)h"7! + (h — z) X` Pa(a)h” — 0. (12.1.19) 
n=0 n=0 


Setting the coefficients of h” equal to zero, we find that 


(n + 1)Pr4i(@) — 2nz P, (x) + (n — 1D) P, (x) + Pa-1 (£) — ©Pp(x) = 0, (12.1.20) 


Or 
(n + 1) Pii (x) — Qn  1)z Ps (x) +nPp-i(x) = 0 (12.1.21) 
with n — 1,2,3,.... 
Similarly, the first-order partial differential equation 
oW 
(1— 2xh + ae -hW =0 (12.1.22) 
z 
leads to ES E 
(1 — 2h +h?) S 5 P, (z)h" — M. P, (a)h"*! —0, (12.1.23) 


n=0 n=0 
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which implies 
Pj a (2) — 22 P, (x) + P) 1(2) ^ Pa(z) = 0. (12.1.24) 


Differentiating Equation 12.1.21, we first eliminate P; ,(x) and then P,,,(v) from the 
resulting equations and Equation 12.1.24. This gives two further recurrence relationships: 


Phaa(t) ho) (n +1)Pa(£)=0, 2501251. (12.1.25) 


and 
xP! (x) — P, 


n—1 


(x) nP4,(r) 20, n=1,2,3,.... (12.1.26) 


Adding Equation 12.1.25 and Equation 12.1.26, we obtain the more symmetric formula 


Pipa (£) — P, 4(z) = (2n + 1) P (s), n —1,2,3,.... (12.1.27) 


Given any two of the polynomials P,,1(x), P,(x), and P, 4(x), Equation 12.1.21 or Equa- 
tion 12.1.27 yields the third. 


e Example 12.1.1 


Let us use Rodrigues’ formula to compute P»(x). From Equation 12.1.14 with n = 2, 


Lb 2 x 


1d 1 
= 23-5 4 2 
=a ge? aaa 


2x 1) = 507 1. (121.28) 


P(x) 


e Example 12.1.2 
Let us compute P3(x) from a recurrence relation. From Equation 12.1.21 with n = 2, 
3P3(r) — 5x P(x) + 2P, (x) = 0. (12.1.29) 


But P2(x) = (3x? — 1)/2, and P(x) = 2, so that 


3P3(x) = 5x P2(x) — 2P, (x) = 5a[(3a* — 1)/2] — 2x = Ba — $r, (12.1.30) 


or 


P3(x) = (52° — 3x) /2. (12.1.31) 


e Example 12.1.3 


We want to show that 


1 
i P,(«x) dx = 0, n> 0. (12.1.32) 
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From Equation 12.1.27, 


(2n 4- 1) L Pa (a) dx = mo — P! _ (x)| dx (12.1.33) 


= Payı (£) - Pa- (£) (12.1.34) 
= Pay (1) — Pa(1) — Pht (—1) + Pa-i(-1) =0, (12.1.35) 


because P,(1) = 1 and P,(—1) = (—1)”. 


Having determined several methods for finding the Legendre polynomial P,,(x), we now 
turn to the actual orthogonality condition.? Consider the integral 


cad f. JURE ELA memi. dS (12.1.36) 
= f ine T APU(x) 4- +h” Pal) +] 

x [Po(z)  &Pi(x) - t" Pale) +] dz (12:1:87) 

= » n hee i P, (x) P (x) dz. (12.1.38) 


n=0 m=0 


On the other hand, if a = (1 +h?)/2h, and b = (1+ t?)/2t, the integral J is 


1 
fe] a (12.1.39) 
-1V1+h2 — 2zh V1 +EP — 2zt 

1 D dx 1 5 ( a T +) 
= = Y : dz (12.1.40) 

Wht Jı V/a—xz Vb—x  VhtJ-1 Va—az 4 Vb—x 

1 ; 1 verti) 

= In( vVa—r+vb-zr = m( : 12.1.41 
v ht ( ıı vVht \Va-14+Vvb-1 ( ) 


But a +1 = (1 +h? +2h)/2h = (1 +h)? /2h, and a— 1 = (1 — h)?/2h. After a little algebra, 


poe «(1598 - : [Vm e s (i + E es (12.1.42) 


Vht \1-vht Vht 
ht Ng Are” 
=2(14+4 F7 epe) (12.1.43) 


As we noted earlier, the coefficient of h”t™ in this series is Si Pa (x)Pm(£) dz. If we match 
the powers of h”t™, the orthogonality condition is 


i 0 m zn 
P4(x) PA (x) dz = : E 12.1.44 
f, RTRS E Lie (12.1.44) 


5 See Symons, B., 1982: Legendre polynomials and their orthogonality. Math. Gaz., 66, 152-154. 
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Some Useful Relationships Involving Legendre Polynomials 


Rodrigues’s formula 


Recurrence formulas 
(n + 1)Pr41(x) — (2n + 1)eP, (x) + nP, (x) = 0, n=1,2,3,... 


Pl (z) — P5 4(2) = (2n + 1)P, (£), n=1,2,3,... 


Orthogonality condition 


i 0, m £n, 
P P. (2) Pm (x) dz = 2 
Sl > MESEN 
2n +1 


With the orthogonality condition, Equation 12.1.44, we are ready to show that we can 
represent a function f(x), which is piece-wise differentiable in the interval (—1,1), by the 
series: 


F) = X Ane. cdam. (12.1.45) 
m=0 


To find Am we multiply both sides of Equation 12.1.45 by P,(x) and integrate from —1 to 
1: 


J FOP) dx = M Am f Pale) Poo) dx. (12.1.46) 


All of the terms on the right side vanish except for n = m because of the orthogonality 
condition, Equation 12.1.44. For this reason, the coefficient An is 


Af. P2(z) de= | fle)Pa(a) dx, (12.1.47) 


P mi : i FP a) ae: (12.1.48) 


In the special case when f(x) and its first n derivatives are continuous throughout the 
interval (—1,1), we may use Rodrigues' formula to evaluate 


[n f (z) P, (x) dz = ! J dup E adi dx = | (a? — 1)” f(a) dx 


Rn! J 4 dz" Pnt Ji 
(12.1.49) 
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by integrating by parts n times. Hence, 
2n 1 ft 
T mus] (1 — 22)" f (3) da. (12.1.50) 


A particularly useful result follows from Equation 12.1.50 if f(x) is a polynomial of degree 
k. Because all derivatives of f(x) of order n vanish identically when n > k, An = 0 if n > k. 
It follows that any polynomial of degree k can be expressed as a linear combination of the 
first k +1 Legendre polynomials [Po(z),..., P(x)]. Another way of viewing this result is to 
recognize that any polynomial of degree k is an expansion in powers of x. When we expand 
in Legendre polynomials we are merely regrouping these powers of x into new groups that 
can be identified as Po(x), Pı (x), Po(x),..., Pi (x). 


e Example 12.1.4 


Let us express f(x) = x? in terms of Legendre polynomials. The results from Equation 
12.1.50 mean that we need only worry about Po(r), Pi(x), and P»(z): 


x? = AgPo(x) + Ai Pı (£) + Ao Po(a). (12.1.51) 
Substituting for the Legendre polynomials, 
z^ = Ag + Aiz + 1A;(32? — 1), (12.1.52) 
and 


3, A,=0, and A45- $. (12.1.53) 


e Example 12.1.5 


Let us find the expansion in Legendre polynomials of the function: 


0, -l<2<0, 
f(x) = { E I (12.1.54) 


We could have done this expansion as a Fourier series, but in the solution of partial differ- 
ential equations on a sphere, we must make the expansion in Legendre polynomials. 
In this problem, we find that 


2+1 f! 
PAE da | P, (a) dz. (12.1.55) 
0 
Therefore, 
1 1 
0) 0 
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so that 
f(x) = }Po(x)  B(2) — EP) + Ps) +. (12.1.58) 


Figure 12.1.3 illustrates the expansion, Equation 12.1.58, where we used only the first four 
terms. It was created using the MATLAB script: 


clear; 
x = [-1:0.01:1]; % create x points in plot 
f = zeros(size(x)); % initialize function f(x) 
for k = 1:length(x) % construct function f(x) 
if x(k) < 0; f(k) = 0; else f(k) = 1; end; 
end 
^ initialize Fourier-Legendre series with zeros 
flegendre = zeros(size(x)); 
^ read in Fourier coefficients 
a(1) = 1/2; a(2) = 3/4; a(3) = 0; 
a(4) = -7/16; a(5) = 0; a(6) 11/32; 
clf % clear any figures 
for n = 1:6 
^4 compute Legendre polynomial 
N = n-1; P = legendre(N,x); 
^4 compute Fourier-Legendre series 
flegendre - flegendre * a(n) * P(1,:); 
% create plot of truncated Fourier-Legendre series 
y, with n terms 
if n--1 subplot(2,2,1), plot(x,flegendre,x,f,’--’); 
legend(?one term?,?f(x)?); legend boxoff; end 
if n--2 subplot(2,2,2), plot(x,flegendre,x,f,’--’); 
legend(’two terms’,’f(x)’); legend boxoff; end 
if n--4 subplot(2,2,3), plot(x,flegendre,x,f,’--’); 
legend(’four terms’,’f(x)’); legend boxoff; 
xlabel(’x’,’Fontsize’,20); end 
if n==6 subplot(2,2,4), plot(x,flegendre,x,f,’--’); 
legend(’six terms’,’f(x)’); legend boxoff; 
xlabel(’x’,’Fontsize’,20); end 
axis([-1 1 -0.5 1.5]) 
end 


As we add each additional term in the orthogonal expansion, the expansion fits f(x) better 
in the “least squares" sense of Equation 11.3.6. The spurious oscillations arise from trying 
to represent a discontinuous function by four continuous, oscillatory functions. Even if 
we add additional terms, the spurious oscillations persist, although located nearer to the 
discontinuity. This is another example of Gibbs phenomena.® See Section 5.2. 


So far we have explored the nature of Legendre polynomials and shown how we may 
expand a well-behaved function as an expansion in Legendre polynomials. We are now 
ready to show how they can be used to solve linear Fredholm integral and partial differential 
equations. 


6 Weyl, H., 1910: Die Gibbs'sche Erscheinung in der Theorie der Kugelfunktionen. Rend. Circ. Mat. 
Palermo, 29, 308-321. 
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Figure 12.1.3: Representation of the function f(x) = 1 for 0 < x < 1 and 0 for —1 < x < 0 by various 
partial summations of its Legendre polynomial expansion. The dashed lines denote the exact function. 


e Example 12.1.6: Numerical solution of linear Fredholm integral equations 


The integral equation 


pc db ezr : 
y(x) =e?" — re II [atu dt (12.1.59) 


is an example of a linear Fredholm integral equation of the second kind: 
1 
y(x) = f(x) + 3! K(a,t) y(t) dt, (12.1.60) 
zy 


where f(x) = e?" — 3re ?/4 — e?a/4, A = 1, and K(z,t) = xt. A quick check shows that 
y(x) = e?" is the solution. In general, these equations must be solved numerically by first 
replacing the integral with some quadrature formula and then solving the resulting system 
of linear equations. 

An alternative would be to assume that the solution can be written as an expansion in 
Legendre polynomials: 


N 
y(z) = V^ AP, (z). (12.1.61) 
n=0 


This method is not new. S. Chandrasekhar’ used it in the 1940s to solve the radiative 
transfer equation. However, we shall follow the work of Yalgmbas, Aynigül and Akkaya® 
who formulated the method using matrix methods. Because the method is elegant and 
serves as a refresher on linear algebra, we employ it here. 

We begin by assuming both f(x) and y(x) can be written as Fourier-Legendre expan- 
sions: 


N 
ue) X Ps OS Pat, (12.1.62) 
n=0 


7 See Chandrasekhar, S., 1944: On the radiative equilibrium of a stellar atmosphere. Astrophys. J., 99, 
180-190. 

8 See Yalgmbas, S., M. Aynigül, and T. Akkaya, 2010: Legendre series solutions of Fredholm integral 
equations. Math. Comput. Appl., 15, 371-381. 
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and 


N 
FE) = Ww Y SP. (12.1.63) 
n=0 


where we have the row vectors a = [ag a1 ... an], £ = [fo fi ... fn], and Pz = [Po(x) Pi (£) 
... Py(x)]. In Problem 15 we show how to compute the Fourier-Legendre coefficients for 
e”. Preforming the same exercise here for e?”, we have that 


fo = co/2, fi = 3c1/2 — 0.75e7? — 0.25e?, and fy =(2n+-1)en/2, (12.1.64) 
where cp = sinh(2), c = cosh(2) — sinh(2)/2, and c441 = Cn_1 — (2n + 1)cn/2 for n > 1. 


Next, let us examine the kernel of the integration. We begin by noting that we can 
write the kernel as 


N N 
Ka =X X krs P, PO). = Pa KPF. (12.1.65) 
r=0 s=0 
For example, 
P(x)\" 70 0 0 0 0 OX /Pilt) 
P, (a) 0100001]|[|2B() 
B MEZ 000 0 0 0] ] Pit) 
at = P,(x)P;(t) = Pale) 00000 01] B® (12.1.66) 
P(x) 000 0 0 0] | Pi(t) 
P3(x) 0000 0 0/ \Ps(t) 


for the special case of N — 5. 
Upon substituting for y, f and K(z,t) into Equation 12.1.60, we have that 


1 
Pza! = P,f? + AP,K (/ PTP, ar) a’, (12.1.67) 
—1 
or j 
al = fT AK (/ PTP, ar) al, (12.1.68) 
Lï 
or 
a” = fT + \KQa’, (12.1.69) 
where 
2 0 0 0 0 
0 2/3 0 0 0 
- 0 0 25 0 0 
Q= J P;Pidt=|Q 0 0 2/7 0 (12.1.70) 
—1 
0 0 0 0 2/(2N +1) 
Finally, we can write 12.1.67 as 
(1=—AKQ)a? = f". (12.1.71) 


Then we can use any computational engine we wish to solve for a. After that, we simply 
substitute into Equation 12.1.62. 
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Figure 12.1.4: Comparison between the Legendre polynomial expansion and the exact solution to the 
linear Fredholm equation, Equation 12.1.59. 


Figure 12.1.4 compares the numerical solution of a linear Fredholm equation, Equation 
12.1.59, where we used a Legendre polynomial expansion against the exact solution when 
we include one, two, three and four terms in the expansion. In this particular problem the 
expansion works well. 


e Example 12.1.7: The potential within a conducting sphere 


Let us use the method of separation of variables to find the potential at any point P 
within a conducting sphere of radius a. The derivation of the Laplacian in polar spherical 
coordinates is given in Appendix B. At the surface, the potential is held at Vo in the 
hemisphere 0 < 0 < 7/2, and —Vo for 4/2 « 0 « m. 

Laplace's equation in spherical coordinates is 


ð ( 50u 1 OT. Qu 
ðr ( 5.) sin(0) 00 E i ee (12.1.72) 


To solve Equation 12.1.72 we set u(r, 0) = R(r)O(0) by separation of variables. Substituting 
into this equation, we have that 


Ld /( .dR\ | 1 dl. dO] > 
Rdr ¢ T) ~ sin(0)O d0 E 71 =k, (12.1.73) 
or 
r? R" + 2rR' —k?R=0, (12.1.74) 
and 


Ede sin | 4 k?0 — 0. (12.1.75) 
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A common substitution replaces 0 with u = cos(0). Then, as 0 varies from 0 to 7, u varies 
from 1 to —1. With this substitution, Equation 12.1.75 becomes 


= fja 12) + k?@=0. (12.1.76) 


This is Legendre’s equation, which we examined earlier. Consequently, because the solution 
must remain finite at the poles, k? = n(n +1), and 


O,(8) = Pa (u) = P, [cos(0)], (12.1.77) 


where n = 0,1,2,3,.... 

'Turning to Equation 12.1.74, this equation is the equidimensional or Euler-Cauchy 
linear differential equation. One method of solving this equation consists of introducing a 
new independent variable s so that r = ef, or s = In(r). Because 


d dsd | 
dr  drds - ds’ 


(12.1.78) 


it follows that 


d  d( ,d sdf d cuu d 
i-a a) = zl a) =e (-5)- wae) 


Substituting into Equation 12.1.74, 


dR, dR, 
ds? ` 


n(n 4- 1)R, — 0. (12.1.80) 


Equation 12.1.80 is a second-order, constant coefficient ordinary differential equation, which 
has the solution 


R,(r) = Cne™ + D,e-*9* = C, exp[nIn(r) + D, exp[—(n + 1)n(r)] (12.1.81) 
= C, exp[In(r")] + D, exp[In(r 1 ^?)] = Cpr” + Dar ^. (12.1.82) 


A more convenient form of the solution is 


T 


R,(r) = An (=) sb. (5 (12.1.83) 


where A, = aC, and B, = D,/ atl, We introduced the constant a, the radius of the 
sphere, to simplify future calculations. 

Using the results from Equation 12.1.77 and Equation 12.1.83, the solution to Laplace's 
equation in axisymmetric problems is 


u(r,0) = Y |^ (=) + Bn (3 P, [cos(0)]. (12.1.84) 


n=0 


In our particular problem we must take B, = 0 because the solution becomes infinite at 
r = 0 otherwise. If the problem had involved the domain a < r < oo, then An = 0 because 
the potential must remain finite as r — oo. 
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Finally, we must evaluate A,. Finding the potential at the surface, 


> Vo, 0<u<1l, 
u(a, u) = 2 ASI) = { Vp, aS zm a (12.1.85) 


Upon examining Equation 12.1.85, it is merely an expansion in Legendre polynomials of 
the function 


m. Vo, 0 « H < 1, 
f(u)- { “Ves Xx reo: (12.1.86) 
Hence, from Equation 12.1.86, 
Qn+1 f! 
An = 5 f(u) Palu) dp. (12.1.87) 
=i 


Because f(u) is an odd function, An = 0 if n is even. When n is odd, however, 


An = (2n +1) I Vo Pa (u) dp. (12.1.88) 


We can further simplify Equation 12.1.88 by using the relationship that 


/ P (t) dt = zi [Pa i(2) — Pr4i(x)], (12.1.89) 


where n > 1. In our problem, then, 


Be { Vo[Pn—1(0) — Pn4i(0)], n odd, (12.1.90) 


0, n even. 


The first few terms are A, = 3Vo/2, A3 = —7Vo/8, and As = 11Vo/106. 
Figure 12.1.5 illustrates our solution. It was created using the MATLAB script: 
clear 
N = 51; dr = 0.05; dtheta = pi / 15; 
^4 compute grid and set solution equal to zero 
r = [0:dr:1]; theta = [0:dtheta:2*pi] ; 
mu = cos(theta); Z =r’ * mu; 


for L = 1:2 
if L == 1X = r? * sin(theta); 
else X = -r’ * sin(theta); end 


u = zeros(size(X)); 
^ compute solution from Equation 12.1.84 
rfactor = r; 
for n = 1:2:N 
A = legendre(n-1,0); B = legendre(n+1,0); coeff = A(1)-B(1); 
C = legendre(n,mu); Theta = C(1,:); 
u = u + coeff * rfactor? * Theta; 
rfactor = rfactor .* r .* r; 
end 
surf(Z,X,u); hold on; end 
xlabel(?Z?,?Fontsize?,20); ylabel(’X’,’Fontsize’ ,20) 
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Figure 12.1.5: Electrostatic potential within a conducting sphere when the upper hemispheric surface has 
the potential 1 and the lower surface has the potential —1. 


zlabel(’u(R,\theta )’,’Fontsize’ ,20); 


Here we have the convergence of the equipotentials along the equator and at the surface. 
The slow rate at which the coefficients are approaching zero suggests that the solution 
suffers from Gibbs phenomena along the surface. 


e Example 12.1.8: Steady-state temperature within a metallic sphere 


Using separation of variables, we now find the steady-state temperature field within a 
metallic sphere of radius a, which we place in direct sunlight and allow to radiatively cool. 
This classic problem, first solved by Rayleigh,® requires the use of spherical coordinates with 
its origin at the center of the sphere and its z-axis pointing toward the sun. The derivation 
of the Laplacian in spherical coordinates is given in Appendix B. With this choice for the 
coordinate system, the incident sunlight is 


D(0) cos(6), 0 


D(6) = { B (12.1.91) 


If heat dissipation takes place at the surface r — a according to Newton's law of 
cooling and the temperature of the surrounding medium is zero, the solar heat absorbed by 
the surface dA must balance the Newtonian cooling at the surface plus the energy absorbed 
into the sphere's interior. This physical relationship is 


Ou(a, 0) 


(1— p) D(0) dA = eu(a,0) dA +K Or 


dA, (12.1.92) 


9 Rayleigh, J. W., 1870: On the values of the integral Je Qn Q;, dh, Qn, Q, being Laplace's coefficients 
of the orders n, n’, with application to the theory of radiation. Philos. Trans. R. Soc. London, Ser. A, 
160, 579-590. 
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where p is the reflectance of the surface (the albedo), e is the surface conductance or 
coefficient of surface heat transfer, and « is the thermal conductivity. Simplifying Equation 
12.1.92, we have that 
Qu(a,0  1l—p 
Ór Rr 


D(0) -u(a, 0) (12.1.93) 


for r — a. 

If the sphere has reached thermal equilibrium, Laplace's equation describes the tem- 
perature field within the sphere. In the previous example, we showed that the solution to 
Laplace's equation in axisymmetric problems is 


u(r,0) = Y |^ (y 4 B, (3 P, [cos(0)]. (12.1.94) 
n=0 


In this problem, B, = 0 because the solution would become infinite at r = 0 otherwise. 
Therefore, 


u(r,6) =X An (5) P, [cos(0)]. (12.1.95) 
n=0 
Differentiation gives 
Ou oS nr?! 
m 2. An qs Paleos(6)} (12.1.96) 


YA, (= + $) P, [cos(0)] = (=) D(0), (12.1.97) 
Di) - 3 E 3650) (12.1.98) 

where 
Cn = Fest An, and u= cos(6). (12.1.99) 


We determine the coefficients by 


mif p | 2n 1 


1 
C, = T Do) f p Pap) dp. (12.1.100) 
2 Ja 2 j 


Evaluation of the first few coefficients gives 


A, Aa P)PO) A, = Ut = A) DO) Ay = 9a(1 = p)D(0) As —0, (12.1.101) 

i 4e i F 2(&--ea) ' 2 16(2 + ea) 3 : a 
3a(1 — p) D(0) 13a(1 — p) D(0) 
Ag = -= A= Ag = ———————, Ar = 12.1.102 
t 32(Ak ea) ^ ^? ELS 256(6%-+ea) ^ ^" ? ( ) 
17a(1 — p)D(0) 49a(1 — p)D(0) 

A = A = A = 2 SE: 

3 512(8& + ea) gO BHO. PS STE d es) HE 


512 Advanced Engineering Mathematics with MATLAB 


Figure 12.1.6: The difference (in °C) between the temperature field within a blackened iron surface of 
radius 0.1 m and the surrounding medium when we heat the surface by sunlight and allow it to radiatively 
cool. 


Figure 12.1.6 illustrates the temperature field within the sphere with D(0) — 1200 
W/m?, k = 45 W/m K, e = 5 W/m? K, p = 0, and a = 0.1 m. This corresponds to a cast 
iron sphere with blackened surface in sunlight. This figure was created by the MATLAB 
Script: 
clear 
dr = 0.05; dtheta = pi / 15; 

D.0 = 1200; kappa = 45; epsilon = 5; rho = 0; a = 0.1; 
^ compute grid and set solution equal to zero 
r = [0:dr:1]; theta = [0:dtheta:pil; 
mu = cos(theta); Z =r’ * mu; 
aaaa = (1-rho) * D.O / ( 4 * epsilon); 
aa(1) = a * (1-rho) * DO / ( 2 * ( kappatepsilon*a)) ; 
aa(2) = 5 * a * (1-rho) * DO / ( 16 * (2*kappatepsilon*a)) ; 
aa(3) = 0; 
aa(4) = - 3 * a * (1-rho) * D0 / ( 32 * (4*kappatepsilon*a)) ; 
aa(5) = 0; 
aa(6) = 13 * a * (1-rho) * DO / ( 256 * (6*kappatepsilon*a)) ; 
aa(7) = 0; 
aa(8) = -17 * a * (1-rho) * DO / ( 512 * (8*kappatepsilon*a)) ; 
aa(9) = 0; 
aa(10) = 49 * a * (1-rho) * D_O / (2048 * (10*kappatepsilon*a)); 
for L = 1:2 
if L == 1X =r’ * sin(theta); 
else X = -r’ * sin(theta); end 
u = aaaa * ones(size(X)); 
^4 compute solution from Equation 12.1.95 
rfactor = r; 
for n = 1:10 
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Figure 12.1.7: Point charge +q in the presence of a grounded conducting sphere. 


m 
ul 


legendre(n,mu); Theta = A(1,:); 
u =u + aa(n) * rfactor’ * Theta; 
rfactor = rfactor .* r; 
end 
surf(Z,X,u); hold on; end 
xlabel(’Z’,’Fontsize’,20); ylabel(’X’,’Fontsize’ ,20); 
zlabel(’U(R,\theta )’,’Fontsize’ ,20); 


The temperature is quite warm with the highest temperature located at the position where 
the solar radiation is largest; the coolest temperatures are located in the shadow region. 


e Example 12.1.9: Potential exterior to a conducting, grounded sphere 


In this example we find the potential at any point P exterior to a conducting, grounded 
sphere centered at z = 0 after we place a point charge +q at z = a on the z-axis. See Figure 
12.1.7. The derivation of the Laplacian in spherical polar coordinates is given in Appendix 
B. From the principle of linear superposition, the total potential u(r,0) equals the sum of 
the potential from the point charge and the potential v(r, 0) due to the induced charge on 
the sphere 


u(r,0) = 2 + w(r,0). (12.1.104) 
8 
In common with the first term q/s, v(r,0) must be a solution of Laplace’s equation. In 


Example 12.1.7 we showed that the general solution to Laplace’s equation in axisymmetric 
problems is 


u(r, 0) = Y |^ (=) + Bn (2) 7 P, [cos(0)]. (12.1.105) 
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Because the solutions must be valid anywhere outside of the sphere, A, = 0; otherwise, the 
solution would not remain finite as r > oo. Hence, 


oo —1-—n 
v(r,9) = Y^ B, (=) P, [cos(6)]. (12.1.106) 
n=0 To 
We determine the coefficient Bn by the condition that u(ro, 0) = 0, or 
= + M BP, [cos(6)] = 0. (12.1.107) 
S lon sphere 


n=0 


We must expand the first term on the left side of Equation 12.1.107 in terms of Legendre 
polynomials. From the law of cosines, 


s = \/r? + a? — 2ar cos(6). (12.1.108) 
Consequently, if a > r, then 
1 1 2 —1/2 
S h — 2cos(0)-— + (5) | (12.1.109) 
S a a a 
Earlier we showed that x) 
(1— 222-22) 17? = ^ PL (az. (12.1.110) 
n=0 
Therefore, 
E eis n 
- = - V P, [cos(6)] (5) l (12.1.111) 
S a a 
n=0 
From Equation 12.1.107, 
X fq (roy 
» |: (3) + B,| P, [cos(8)] = 0. (12.1.112) 


We can only satisfy Equation 12.1.112 if the square-bracketed term vanishes identically so 
that 


[E (3) l (12.1.113) 
a a 


On substituting Equation 12.1.113 back into Equation 12.1.106, 


v(r,0) = -2 5 eal P, [cos(6)]. (12.1.114) 


'The physical interpretation of Equation 12.1.114 is as follows: Consider a point, such 
as a’ (see Figure 12.1.7) on the z-axis. If r > a’, the Legendre expansion of 1/s' is 


s! 


oo Inn 
L- LS > Prlcos(0) (=) ; To. (12.1.115) 
n=0 
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Figure 12.1.8: Electrostatic potential outside of a grounded conducting sphere in the presence of a point 
charge located at a/rg = 2. Contours are in units of —q/ro. 


Using Equation 12.1.115, we can rewrite it as 
v(r,0) = -2 (12.1.116) 


if we set a’ = r2/a. Our final result is then 


/ 
i) =1- L (12.1.117) 


s s 
provided that q’ equals roq/a. In other words, when we place a grounded conducting sphere 
near a point charge +q, it changes the potential in the same manner as would a point charge 
of the opposite sign and magnitude q’ = roq/a, placed at the point a’ = r2/a. The charge 
q' is the image of q. 
Figure 12.1.8 illustrates the solution, Equation 12.1.114, and was created using the 
MATLAB script: 


clear 
aoverr0 = 2; 
^ set up x-z array 
dx = 0.02; x = -3:dx:3; dz = 0.02; z = -3:dz:3; 
u = 1000 * zeros(length(x) ,length(z)) ; 
X = x’ * ones(1,length(z)); Z = ones(length(x),1) * z; 
% compute r and theta 
rr = sqrt(X .* X +Z .* Z); 
theta = atan2(X,Z); 
% find the potential 
r_over_aprime = a over rO * rr; 
s = 1 + r_over_aprime .* r over aprime 
- 2 * r_over_aprime .* cos(theta) ; 
for j = 1:length(z); for i = 1:length(x); 
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if rr(i,j) >= 1; u(i,j) = 1 ./ sqrt(s(i,j)); end 
end; end 
^4 plot the solution 
[cs,h] = contourf(X,Z,u); colormap(hot); brighten(hot,0.5); 
axis square; clabel(cs,h,’manual’,’Fontsize’ ,16); 
xlabel(’X’,’Fontsize’,20); ylabel(’Z’,’Fontsize’ ,20); 
Because the charge is located directly above the sphere, the electrostatic potential for any 
fixed r is largest at the point 0 = 0 and weakest at 0 = m. 


Problems 


Find the first three nonvanishing coefficients in the Legendre polynomial expansion for the 
following functions: 


0, Hee <0; _ Jie), dz «e 
1. sea) = [t 0«mc« Il. a f) { 0, e< |a| « 1, 
3. f(x)=|e|, — |z| <1. 4 f(z)--2,  |r| «1. 

-1 -1«r«0, | .j]-4 -1«z«0, 
5 nasl 0<r<1. » ips O<a<l. 


Then use MATLAB to illustrate various partial sums of the Fourier-Legendre series. 
7. Use Rodrigues's formula to show that Py(x) = 1(35z* — 30x? + 3). 


8. Given P5(x) = S25 — Vr? + Bx and P;(x) from Problem 7, use the recurrence formula 
for P,+1(x) to find Ps(x). 


9. Show that (a) P,(1) = 1, (b) P,(—1) = (-1)”, (c) P»441(0) = 0, and (d) P»4(0) = 
(—1)* (2n)!/ (2?^n!n!). 


10. Prove that 


2n 1 
11. Given!? 
1 1 
P, [cos( -2[ cos|( = -2f sin|( r dn 
v/2[cos(x) — cos(0 v/2[cos(0) — cos(a:)] 
show that the following generalized Fourier series holds: 
H(0 — > 
= Do Peoc [(a +3), OS t< ISR, 


V2 cos(t) — er 


10 Hobson, E. W., 1965: The Theory of Spherical and Ellipsoidal Harmonics. Chelsea Publishing Co., 
pp. 26-27. 
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if we use the eigenfunction y,(x) = cos[(n-- 2)z], 0 < £x < m, r(x) = 1 and H(-) is 
Heaviside's step function, and 


H(t— 6) 
V2 cos(0) — 2 cos 


= XC Palcos(4)] sin[(n+$)t], 0x0«tzm, 
(t) n=0 
if we use the eigenfunction y,(r) = sin|(n + 3)z], 0 < x < m, r(x) = 1 and H(-) is 
Heaviside’s step function. 


12. The series given in Problem 11 are also expansions in Legendre polynomials. In that 
light, show that 


[ P,,[cos(@)] sin(0) PE sin[(n + 3) t] 
o v/2cos(0) — 2 cos(t) nai í 


and 
7 Palcos(0)] sin(0) " cos| (n + 3) t] 


+ V/2cos(t) — 2cos(0) nai 


where 0 «€ t « m. 


13. (a) Use the generating function, Equation 12.1.15, to show that 


1 % E 
Fae Pal), de <4, 1<] 


n=0 


(b) Use the results from part (a) to show that 


1 = 1 
XD e (t2) p. x), qe. 
cosh(u) — x » e) ia 


Hint: 


00 48 
Jeosh(u)— x velel = 2a + ell 


14. The generating function, Equation 12.1.15, actually holds!! for |h| € 1 if |x| < 1. Using 
this relationship, show that 


= 1 
2, Pala) = JA - x) zy |x| < 1; 


and 
e Pale) 2|1c--z)/2 
» need — |n cae | |z| « 1. 


Use these relationships to show that 


S udo cds B c etg 1+ /ü-3)/2 
a den am ia In (12/2 | b 


11 Tbid., p. 28. 
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Figure 12.1.9: Representation of the function f(x) = e7 for —1 < x < 1 by various partial summations of 
its Legendre polynomial expansion. The dashed lines denote the exact function. 

if || < 1. 

15. Find the Fourier-Legendre expansion for f(x) = e”. 


Step 1: Show that the Fourier-Legendre coefficients are given by 


2n 4-1 
An = uu: Cn, where eu J e” Pa (x) dx. 
A 


Step 2: Using integration by parts, show that 
1 
Cn = e — (-1)^e !— I e” P' (x) dz. 
-1 
Hint: Use Problem 9. 
Step 3: Show that ¢n41—Cn_1 = —(2n--1)c, for n > 1, where co = 2sinh(1) and c1 = 2e7!. 
Hint: Use Equation 12.1.27. Figure 12.1.9 illustrates the expansion for several partial sums. 


Step 4: Redo the problem for f(x) = e7”. 
Linear Fredholm Integral Equation 


Utilizing Example 12.1.6, employ Fourier-Legendre expansions to solve the following linear 
Fredholm integral equations of the second kind: 


16. 
1 


y(x) = (x +1)? + J (xt + z?t?)y(t) dt 


—1 
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17. 
18. 


Separation of Variables Solution to Laplace’s Equation 


19. Find the steady-state temperature within a sphere of radius a if the temperature along 
its surface is maintained at the temperature u(a, 0) = 100[cos(0) — cos?(0)]. 


20. Find the steady-state temperature within a sphere if the upper half of the exterior 
surface at radius a is maintained at the temperature 100 while the lower half is maintained 
at the temperature 0. 


21. The surface of a sphere of radius a has a temperature of zero everywhere except in a 
spherical cap at the north pole (defined by the cone 0 = o), where it equals Tp. Find the 
steady-state temperature within the sphere. 


12.2 BESSEL FUNCTIONS 


In the previous section we discussed the solutions to Legendre's equation, especially 
with regard to their use in orthogonal expansions. In this section we consider another classic 
equation, Bessel's equation!? 


gy” + acy! + (uz? — n?)y = 0, (12.2.1) 


d dy 2 n? x 
3163 + (1 z— -) y =0. (12.2.2) 


Once again, our ultimate goal is the use of its solutions in orthogonal expansions. These 
orthogonal expansions, in turn, are used in the solution of partial differential equations in 
cylindrical coordinates. 

A quick check of Bessel's equation shows that it conforms to the canonical form of the 
Sturm-Liouville problem: p(x) = z, q(x) = —n?/z, r(x) = x, and A = 42. Restricting our 
attention to the interval [0, L], the Sturm-Liouville problem involving Equation 12.2.2 is 
singular because p(0) = 0. From Equation 12.0.8 the eigenfunctions of a singular Sturm- 
Liouville problem will still be orthogonal over the interval [0, L] if (1) y(x) is finite and zy’ (x) 
is zero at x = 0, and (2) y(x) satisfies the homogeneous boundary condition, Equation 12.0.2, 
at x = L. Thus, we only seek solutions that satisfy these conditions. 

We cannot write down the solution to Bessel's equation in a simple closed form; as in 
the case with Legendre's equation, we must find the solution by power series. Because we 
intend to make the expansion about x = 0 and this point is a regular singular point, we must 


12 Bessel, F. W., 1824: Untersuchung des Teils der planetarischen Stórungen, welcher aus der Bewegung 
der Sonne entsteht. Abh. d. K. Akad. Wiss. Berlin, 1-52. See Dutka, J., 1995: On the early history of 
Bessel functions. Arch. Hist. Exact Sci., A9, 105-134. The classic reference on Bessel functions is Watson, 
G. N., 1966: A Treatise on the Theory of Bessel Functions. Cambridge University Press, 804 pp. 
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It was Friedrich Wilhelm Bessel's (1784-1846) apprenticeship to the famous mercantile firm of 
Kulenkamp that ignited his interest in mathematics and astronomy. As the founder of the German 
school of practical astronomy, Bessel discovered his functions while studying the problem of planetary 
motion. Bessel functions arose as coefficients in one of the series that described the gravitational 
interaction between the sun and two other planets in elliptic orbit. (Portrait courtesy of Photo 
AKG, London, with permission.) 


use the method of Frobenius, where n is an integer.!? Moreover, because the quantity n? 
appears in Equation 12.2.2, we may take n to be nonnegative without any loss of generality. 


To simplify matters, we first find the solution when u = 1; the solution for u Z 1 
follows by substituting ux for x. Consequently, we seek solutions of the form 


ylz) = X. Bague = Vk an Bua? 971, (12.2.3) 
k=0 k=0 
and 
y" (x) = So (2k + s)(2k + s — 1) B,a?**5-?, (12.2.4) 


> 
ll 
o 


where we formally assume that we can interchange the order of differentiation and summa- 
tion. The substitution of Equation 12.2.3 and Equation 12.2.4 into Equation 12.2.1 with 


13 This case is much simpler than for arbitrary n. See Hildebrand, F. B., 1962: Advanced Calculus for 
Applications. Prentice-Hall, Section 4.8. 
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H = 1 yields 


oo 


(2k -- s)(2k-- s — 1) Byz? ts +X "(2k - s) By? 9 +X Bug? 1? X gugtets — 0, 


k=0 k=0 k=0 k=0 
(12.2.5) 
or TA ES 
S [Gk + 8)? — n?|Bua?* + V^ Bia??? — 0. (12.2.6) 
k=0 k=0 


If we explicitly separate the k = 0 term from the other terms in the first summation in 
Equation 12.2.6, 


(s? — n?)Bo + V [(2m + 8)? — 07] Bua?" + V^ Byx?*+? = 0. (12.2.7) 
m=1 k=0 


We now change the dummy integer in the first summation of Equation 12.2.7 by letting 
m = k + 1 so that 


(s? — n?) Bo + S MG ^L5342)7-—m?]B44- B,)a2**? — 0. (12.2.8) 
k=0 


Because Equation 12.2.8 must be true for all x, each power of x must vanish identically. 
This yields s = +n, and 


[(2k +s -- 2)? —n7| Busi +B, = 0. (12.2.9) 


Since the difference of the larger indicial root from the lower root equals the integer 2n, we 
are only guaranteed a power series solution of the form given by Equation 12.2.3 for s — n. 
If we use this indicial root and the recurrence formula, Equation 12.2.9, this solution, known 
as the Bessel function of the first kind of order n and denoted by J; (x), is 


v5 (C1)*(g/2)?* 
In (x) = 3 Doo ^ (12.2.10) 


To find the second general solution to Bessel's equation, the one corresponding to 
s — —n, the most economical method!^ is to express it in terms of partial derivatives of 
Ja (x) with respect to its order n: 


Yate) | a -( rH = (12.2.11) 


Upon substituting the power series representation, Equation 12.2.10, into Equation 12.2.11, 


Ys = I(t) In(z/2) 23 = Pi 


1 X^ (21) (2/2) +2 
222 k!(n + k)! 


[U(k 4- 1) - v(k 4 n +1), (12.2.12) 


14 See Watson, op. cit., Section 3.5, for the derivation. 
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Figure 12.2.1: The first four Bessel functions of the first kind over 0 € x < 8. 


where 


V(m-1)2-y41- zc +, (12.2.13) 


w(1) = —*, and y is Euler's constant (0.5772157). In the case of n = 0, the first sum 
in Equation 12.2.12 disappears. This function Y, (x) is Neumann’s Bessel function of the 
second kind of order n. Hence, the general solution to Equation 12.2.1 is 


ylz) = AJn (ux) + BY; (ux). (12.2.14) 


Although Equations 12.2.10 and 12.2.12 provide precise methods for computing J,, (x) 
and Y, (x), they are not particularly insightful. Consider now the limit x — oo. It can be 
shown!? that 


a nT T 
Ja (x) ~ 2 cos(x 5 =) ; (12.2.15) 


and 


2 
Yala) ~ f= sin(z > *). (12.2.16) 


Clearly Bessel functions of the first kind are mathematical cousins to the trigonometric 
functions cosine and sine. I say “cousins” rather than “brothers and sisters” because they 
are distinctly different; their amplitudes decrease as 1/4/z as x increases. 

Turning to the limit of x — 0 we find that 


Ja (a) ~ ($2)" /T(n +1), (12.2.17) 


and 
Yo(x) ~ — (2/7) ln(x), Y, (a) z —[F(n)/z] (iz), (12.2.18) 


where I'(-) is the gamma function. We see that J,,(a) is well behaved near x = 0 while Y, (x) 
tends to negative infinity near the origin. These results are confirmed in Figure 12.2.1 which 


15 Watson, op. cit., Chapter VII. 
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Figure 12.2.2: The first four Bessel functions of the second kind over 0 < z < 8. 


illustrates the functions Jo(x), Ji(x), Jo(x), and Ja(x) and Figure 12.2.2 which gives Yo(z), 
Yi (x), Yo(x), and Ys(x). 
An equation that is very similar to Equation 12.2.1 is 


d? 
D Ex 


(n? + z?)y — 0. (12.2.19) 


It arises in the solution of partial differential equations in cylindrical coordinates. If we 
substitute 4x = t (where i = /—1) into Equation 12.2.19, it becomes Bessel's equation: 


d? 
ae 


: dt? dt 


+ (P? — n*)y « 0. (12.2.20) 


Consequently, we may immediately write the solution to Equation 12.2.20 as 
y(x) = eJ (ix) + c2Yn (ix), (12.2.21) 
if n is an integer. Traditionally, the solution to Equation 12.2.20 has been written 
y(z) = eil, (x) + c2Kn (£) (12.2.22) 
rather than in terms of J, (ix) and Y, (ix), where 
e-Y RU and — K,(x)— aaa [Jn (ix) + 1Y;, (tx) . (12.2.23) 


The function J„ (x) is the modified Bessel function of the first kind, of order n, while Kn (x) 
is the modified Bessel function of the second kind, of order n. 
Once again, it is useful to examine their behavior for large and small z. We find that 


In(at) ~ T=, and Kala) ~ y 677, (12.2.24) 


as x — oo, while 


I,(2) = (42)"/PT(n+1), and Ko(x)x—In(z), Kae)» iT (n) (42), 
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Figure 12.2.3: The first four modified Bessel functions of the first kind over 0 € x < 3. 


where l'(-) is the gamma function. From these limits we see that [,,(-) and K,,(-) are 
mathematical cousins of e” and e~*, respectively. Furthermore, [,,(-) is well behaved near 
x = 0 while K,,(-) tends to infinity. These results are confirmed in Figure 12.2.3 which 
illustrates Jo(z), I(x), I2(x), and I3(z) and in Figure 12.2.4 which plots Ko(x), Ki(x), 
K(x), and K3(x). Note that K,,(a) has no real zeros while J„(x) equals zero only at z = 0 
for n > 1. 

As our derivation suggests, modified Bessel functions are related to ordinary Bessel 
functions via complex variables. In particular, Jn (iz) = i" L,(z), and I,(iz) = i" Jn(z) for 
z complex. 

We must now find how J,(x) is related to Jn+ı(x£) and J, 1(z). Assuming that n is a 
positive integer, we multiply the series, Equation 12.2.10, by z" and then differentiate with 
respect to x. This gives 


dos yy D ODEO P (CD(s 
as i nel "£u XP + E) E » k(n-1+h! Jazi) 
(12.2.26) 
or 
d n Xn 
dz E Ja(2)] = 2" Jui (a) (12.2.27) 


for n = 1,2,3,.... Similarly, multiplying Equation 12.2.10 by z^", we find that 


d =f —FL 
gl Jnl) = =r "In 41 (x) (12.2.28) 
for n = 0,1,2,3,.... If we now carry out the differentiation on Equation 12.2.27 and 


Equation 12.2.28 and divide by the factors z^", we have that 


A, (2) + nE) = In—1(2), (12.2.29) 
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Figure 12.2.4: The first four modified Bessel functions of the second kind over 0 € x < 3. 


and T 
J (x) — PELIC = ex atm. (12.2.30) 


Equation 12.3.29 and Equation 12.3.30 immediately yield the recurrence relationships 


dicatus e T Ila) (12.2.31) 


and 


Jn—1(2) = Janette) — 2J, (x) (12.2.32) 


for n = 1,2,3,.... For n = 0, we replace Equation 12.2.31 by Jj(x) = —Ji(x). Many of the 
most useful recurrence formulas are summarized in Table 12.2.1 for Bessel functions. 


e Example 12.2.1 


Starting with Bessel's equation, we show that the solution to 


1-2 RE 
yl + a4 (er PE - is E =0 (12.2.33) 
T x 
is 
y(x) = Ax" Jn (bx°) + Bz^Y,(bz*), (12.2.34) 
provided that bx* > 0 so that Y, (bx*) exists. 
'The general solution to 
d^n | dn 
2 2^2 
=0 12.2.35 
Oo Eg E- (12.2.35) 
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Table 12.2.1: Some Useful Relationships Involving Bessel Functions of Integer Order 


2 
Jn1(2) + Jagi(z) = L Jala), n=1,2,3,... 


In—1(2) — Ingi(z) = 2J (2), n2 1,2,3,...; Jg(z) = —A() 
d 


Elat) = 2" Jai (2), n--—1,2,3,:.: 
dz 


|n ——zJa(z), n —0,1,2,3,... 
dz 


In-1(2) — In4i(z) = Sin), f; 52594. 


In-1(2) + a2) = 2 ey n= 1,2,3,...; Tolz) a) 
2 
Ky-1(2) — Karl) =E Ka) — n-128... 


Kn-1(2) + Kn41(2) = —2K! (2), n = 1,2,3,...; Ko(z) =—Ki(z) 
Jn (ze) = pucr a(z) 

I(ze"*) ZEN QUITO 
Kylee" ™ eg mam fe = mri Ene) n(Z) 
Ip(z) = e72 Jp (ze), —r < arg(z) € 1/2 


In (z) =e"? J, (gg 902. 7/2 < arg(z) <T 


is 


n = AJ4(£) + BYn (£). 


(12.2.36) 
If we now let 7 = y(z)/x* and € = bz®, then 
d 1—c d? 2—2c 42 —1 1—2c 
d zd NE: d t d (c — 1)x 2 (12.2.37) 
dE | d£ dx bc dz dé? be dx? bc? dx 
d(yN | 1 dy d ary) 1dy 2a dy  a(l+a) 
da ee T mdr geri? ane dx? imd ~ gadr? gtldr — gat? 


(12.2.38) 
Substituting Equation 12.2.37 and Equation 12.2.38 into Equation 12.2.35 and simplifying 
yields the desired result. 
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e Example 12.2.2 


Let us find!? the general solution to the nonhomogeneous differential equation 


dy  1dy 
k^y =—S 12.2.3 
Lt nnb k?y = S(r), (12.2.39) 
where k is a real parameter. 
'The homogeneous solution is 


Using variation of parameters, we assume that the particular solution can be written 


yp(r) = A(rMo(kr) + B(r)Ko(kr), (12.2.41) 
where 
1 = 0 Ko( (kr) Io (kr) Ko(kr) 
ADS | —S(r) kKl(kr) — kr) kK (kr) |? 2.242) 
and 
j Io( (kr) Io( (kr) Ko(kr) 
Basis | KI ae 2 KI pes kK} (kr) |" (12:243) 
Expanding the determinants, we find 
A'(r) = S(r) Ko(kr)/ {k [Io(kr) Ko(kr) — Ig(kr) Ko(kr)]) (12.2.44) 
and 
B'(r) = —S(r)Io(kr)/ {k [Io(kr) Ko(kr) — Ig(kr) Ko(kr)]) . (12.2.45) 
Evaluating the Wronskian!" for modified Bessel functions, 
Io(z)Ko(z) — Ig(z)Ko(z) = —1/z, (12.2.46) 
A'(r) = —rS(r)Ko(kr) and B'(r) 2 rS(r)Io(kr). (12.2.47) 


Integrating the previous equations, 
A(r) = -f zS(x)Ko(kx) dx and B(r) = / xS (x)Io(kx) da. (12.2.48) 


Hence, the general solution is the sum of the particular and homogeneous solutions, 


r 


y(r) = Cylo(kr) + C3 Ko(kr) — Io(kr) i xS (x)Ko(kx) dx + Koler) f xS (x)lIo(kx) dx. 
(12.2.49) 


16 See Hassan, M. H. A., 1988: Ion distribution functions during ion cyclotron resonance heating at the 
fundamental frequency. Phys. Fluids, 31, 596—599. 


17 Watson, op. cit., p. 80, Formula 19. 
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e Example 12.2.3 


Let us show that 


z?J/(z) = (n? — n — a?)J4(x) + xJa41(a). (12.2.50) 

From Equation 12.2.30 
Ji (a) = Č In(2) — Jayi (2), (12.2.51) 

x 
1 n n H $ 
Ji (x) = -gà)»(2) + PED — Ja41 (2), (12.2.52) 
and 
i n nn n+1 

J(e) = — (m) = EO - Insi(2)| — | Ja(£)— Inai(a)| (12.2.53) 


after using Equation 12.2.29 and Equation 12.2.30. Simplifying, 


J'(s) = (5 L i) Ja (£) + zm (12.2.54) 


After multiplying Equation 12.2.54 by z?, we obtain Equation 12.2.50. 
e Example 12.2.4 


Let us show that 


a? Jo(x) dz = a? Ja(a) — 2a*J4(a). (12.2.55) 
0 


We begin by integrating Equation 12.2.55 by parts. If u = z?, and dv = z? Jo(x) dz, 
then 


| x’ Jo(x) dx = a? Js (a) | — z| z^ J3(x) da, (12.2.56) 
0 0 


because d[z? Ja3(x)|/dx = x?Jo(x) by Equation 12.2.27. Finally, 


| z? Jo(x) dz = a? J3(a) — 2x Ju(x)|5 = a? J3(a) — 2a*J4(a), (12.2.57) 
0 


since z*Ja(x) = d[x^J4(x)]/dx by Equation 12.2.27. 


e Example 12.2.5: Finding the zeros of Jo(-) 


Unlike sine and cosine, the zeros of the Bessel function Jo(-) cannot be written down 
analytically but must be found numerically. From Equation 12.2.15, a good first guess 
would be £m = n2/2 + (2m — 1)/2 -- 1/4. We can then use the Newton-Raphson method 
to obtain the exact answer to any degree of accuracy. In the present case, the kth iteration 
equals 


(k) (k) 
gU = g) Fam) _ ahh) + Tolem) (12.2.58) 


r PG) A (22) 
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Table 12.2.2: The First Ten Zeros of Jo(-) Found Using the Newton-Raphson Method. 


The Boldface Digits Are Those that Differ from the Exact Answer. 


(2) 


529 


m first guess a) Lm exact 
1 2.35619449 2.40436809 2.40482551 2.40482556 
2 5.49778714 5.52003672 5.92007811 5.52007811 
3 8.63937980 8.65371699 8.65372791 8.65372791 
4 11.78097245 11.79153010 11.79153444 11.79153444 
5 14.92256510 14.93091557 14.93091771 14.93091771 
6 18.06415776 18.07106276 18.07106397 18.07106397 
7 21.20575041 21.21163588 21.21163663 21.21163663 
8 24.34734307 24.35247104 24.35247153 24.35247153 
9 27.48893572 27.49347879 27.49347913 27.49347913 

10 30.63052837 30.63460622 30.63460647 30.63460647 


Table 12.2.2 presents results from a simple MATLAB code that compares the first guess and 
two successive iterations with the exact solution. Here f(x) = Jo(x) and f'(x) = Jo(x) = 
—Jı (x). It shows that a mere two iterations give the correct zero. 


Let us now turn our attention to the method for re-expressing a well-behaved function 
f(x) in terms of Bessel functions, a Fourier-Bessel series. Although we found solutions to 
Bessel's equation, Equation 12.2.1, as well as Equation 12.2.19, can we use any of them in 
an eigenfunction expansion? Referring back to the discussion following Equation 12.0.8 we 
see that the Bessel function must satisfy two conditions. 

Consider the second condition now. The first part requires that x times the derivative 
of the Bessel function must tend to zero as x — 0. From Figures 12.2.1-12.2.4 we see that 
Ja(x) and In(x) remain finite at x = 0 while Y,(r) and K,,(a) do not. Furthermore, the 
products xJ7 (x) and zI}, (x) tend to zero at x = 0. Thus, both J,(x) and I,(x) satisfy the 
first part of the second requirement for a Fourier-Bessel expansion. 

'The second part requires that the Bessel function must satisfy the homogeneous bound- 
ary condition: yy,(b) + dy, (b) = 0 with y z 0 and/or ô Z 0. From Figure 12.2.3 we see that 
In(x) can never satisfy this condition, while from Figure 12.2.1, J,(x) can. For that reason, 
we discard I„(x) from further consideration and continue our analysis only with Jn (x). 

The exact form of the expansion depends upon the boundary condition at x = L. 
There are three possible cases. One of them is y(L) — 0 and results in the condition 
that J,(u,L) = 0. Another condition is y'(L) = 0 and gives J) (uL) = 0. Finally, if 
hy(L) +y'(L) = 0, then hJn(uk L) + wed) (px. L) = 0. In all of these cases, the eigenfunction 
expansion is the same, namely 


T8) = AS oe): (12.2.59) 
k=1 


where ju, is the kth positive solution of either Jn(uk L) = 0, J} (uy L) = 0, or hJn (pL) + 
px Jr (ui D) = 0. 
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We now need a mechanism for computing Aj. We begin by multiplying Equation 
12.2.59 by zJ4(u,z) dx and integrate from 0 to L. This yields 


oo L L 
Daf Jalsa) Jia) de = f Lf (2) In(Umx) dz. (12.2.60) 


From the general orthogonality condition, Equation 12.0.8 with the right side equal to zero, 


Ñ 
j. aJ uaz)Js usc) dx = 0, (12.2.61) 
0 


if k Am. Equation 12.2.60 then simplifies to 


L L 
Am | akiai Lf (a) In(Umx) da, (12.2.62) 
0 0 
Or 
1 L 
Ay = a] z f (x)Js (pix) dx, (12.2.63) 
Ck 0 
where 
L 
a= f xJ? (nya) dz, (12.2.64) 
0 


and k replaces m in Equation 12.2.62. 
The factor Ck depends upon the nature of the boundary conditions at x = L. In all 
cases we start from Bessel's equation 


lez ur (ue - T) rta) =0. (12.2.65) 


If we multiply both sides of Equation 12.2.65 by 2xJ} (uz), the resulting equation is 


(ida? — n?) [20] = — le (un)? (12.2.66) 


An integration of Equation 12.2.66 from 0 to L, followed by the subsequent use of integration 
by parts, results in 


L L 


L 
e ag f J? (uy) da = -|a J) (uke)? (12.2.67) 
0 


(uga^ — n?)J2(uxx) 


0 [U 


Because J4(0) = 0 for n > 0, Jo(0) = 1 and zJ} (x) = 0 at x = 0, the contribution from the 
lower limits vanishes. Thus, 


L 
1 
Ck =} 2 J, (une) da = ye jože — n’) Jaluk L) + LaL). (12.2.68) 
[U k 
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Because ji 
Jy (Mkt) = z Innen) — m Jua (Mee) (12.2.69) 


from Equation 12.2.30, Ck becomes 


Cr = $1275 a (uel), (12.2.70) 


if J, (uj D) = 0. Otherwise, if J! (uj D) = 0, then 


JZ (ug E). 12.2.71 
zo em 


Finally, 


u uL? —n? + h?L? 


Ck 
m 


Jo (us), (12.2.72) 


if Led) (URL) = —hJn (ul). 

All of the preceding results must be slightly modified when n = 0 and the boundary 
condition is Jj(u,L) = 0 or uj Ji(pj L) = 0. This modification results from the additional 
eigenvalue uo = 0 being present and we must add the extra term Ag to the expansion. For 
this case the series reads 


F(x) = Ao + X Ar Jo(uee), (12.2.73) 
k=l 


where the equation for finding Ao is 


9 [fL 
Ao = F f(x) ada, (12.2.74) 
L? Jo 
and Equation 12.2.63 and Equation 12.2.71 with n — 0 give the remaining coefficients. 


e Example 12.2.6 
Let us expand f(x) = x, 0 < x < 1, in the series 
f(z) = XL AkAi (usa), (12.2.75) 
k=1 
where ju, denotes the kth zero of Jı (u). From Equation 12.2.63 and Equation 12.2.70, 


2 1 
Ay = mus] xz? JA (ugar) da. 12.2.76 
k Feb) A iui ) ( ) 
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However, from Equation 12.2.27, 


d [2 ith 
zs Ja(a)] — z^ Jilt); 


if n — 2. Therefore, Equation 12.2.76 becomes 


22? Jo (a) |"* 2 
Ak = 355 ES , 
As J3 (ux) lo Ix Jo(pi.) 
and the resulting expansion is 
A( (ua) 
r=2 3o sape t 


< uat Ik) 


(12.2.77) 


(12.2.78) 


(12.2.79) 


Figure 12.2.5 shows the Fourier-Bessel expansion of f(x) — x in truncated form when we 
only include one, two, three, and four terms. It was created using the MATLAB script: 


clear; 
= [0:0.01:1]; 4 create x points in plot 
f = x; % construct function f(x) 
^ initialize Fourier-Bessel series 
fbessel = zeros(size(x)); 
^ read in the first four zeros of J_1(mu) = 
mu(1) = 3.83171; mu(2) = 7.01559; 
mu(3) = 10.17347; mu(4) = 13.32369; 
clf ^4 clear any figures 
for n = 1:4 
^4 Fourier coefficient 
factor - 2 / (mu(n) * besselj(2,mu(n))); 
^4 compute Fourier-Bessel series 
fbessel = fbessel + factor * besselj(1,mu(n)*x); 
^4 create plot of truncated Fourier-Bessel series 
% with n terms 
subplot(2,2,n), plot(x,fbessel,x,f,’--’) 
axis([O 1 -0.25 1.25]) 
if n == 1 legend(’1 term’,’f(x)’); legend boxoff; 


else legend([num2str(n) ? terms’],’f(x)’); legend boxoff; 


end 
if n > 2 xlabel(’x’,’Fontsize’,20); end 
end 


e Example 12.2.7 


Let us expand the function f(x) = z?, 0 < x « 1, in the series 


a) = $^ Ar Jo(une), 


k=1 


(12.2.80) 


where j4; denotes the kth positive zero of Jo(u). From Equation 12.2.63 and Equation 


12.2.70, 
2 


1 
A -z f es x) da. 
Gas or 


(12.2.81) 
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Figure 12.2.5: The Fourier-Bessel series representation, Equation 12.2.79, for f(x) = x, 0 <a < 1, when 
we truncate the series so that it includes only the first, first two, first three, and first four terms. 


If we let t = ux, the integration, Equation 12.2.81, becomes 


9 Hk 
Ay = uu] t Jolt) dt. 12.2.82 
E ET Jo o 


We now let u = t? and dv = tJo(t) dt so that integration by parts results in 
A7 as PRO -2 f^ fno = e pne) -2f^ P0 
ui (uk) i 0 uu) U^ 0 i 
(12.2.83) 


because v = tJi (t) from Equation 12.2.27. If we integrate by parts once more, we find that 
2 


2 3. [4i(uk) — 2J2(ux) 
IQ) Lib qa) x RA) =z | | 


Ar = 
Pluk) | Hk [mi 


(12.2.84) 


However, from Equation 12.2.31 with n = 1, Jı (uk) = due [Jo(ux) + Jo(us)], or Jo(ux) = 
2J1(ux)/ ui, because Jo(uzx) = 0. Therefore, 


2(ui T 4)Ji (uk) = 4) Jo (pua) 
Ap = ——M—M—ÀÁÀ——, and =2 — Ha! 0 « x « 1. 
URI? (uk) D s pj J) (Uk) 


(12.2.85) 


Figure 12.2.6 shows the representation of x? by the Fourier-Bessel series, Equation 12.2.85 
when we truncate it so that it includes only one, two, three, or four terms. As we add each 
additional term in the orthogonal expansion, the expansion fits f(x) better in the “least 
squares” sense of Equation 11.3.6. 


e Example 12.2.8 


Let us construct the Fourier-Bessel expansion for 


ci 
aT) -Y Ae. 0<r<1, (12.2.86) 
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Figure 12.2.6: The Fourier-Bessel series representation, Equation 12.2.85, for f(x) = 27, 0 < x < 1, when 
we truncate the series so that it includes only the first, first two, first three, and first four terms. 


where kn denotes the nth positive zero of Jo(k). From Equation 12.2.63 and Equation 
12.2.70, 


2 ! Iọ(Mr) 
a 7 pie | Io(M) Jo(k,r)r dr. (12.2.87) 


To evaluate the integral, we first write down the governing differential equations for Jo(knr) 
and Jo(Mr): 


1 d , dJokar) 
r dr dr 


| + k? Jo(knr) = 0, (12.2.88) 


and 


dr 


rdr 


1d | mam) M?h(Mr) — 0. (12.2.89) 


Multiply Equation 12.2.89 by Jo(knr) and subtracting the resulting equation from Equation 
12.2.88 after we have multiplied it by Jo(Mr), we find that 


d(rIo(Mr)Jo(k,r) — rJo(k,)Io(Mr)] + (M? + k2)Io(Mr)Jo(knr)rdr=0. — (12.2.90) 


Next, we integrate Equation 12.2.90 from 0 to 1. Using the facts that Jo(k,) = 0 and 
Jo(k,r) = —kn Jı (knr), we obtain 


L Io(Mr)Jo(knr)r dr En Io(M) Jı (kn). (12.2.91) 


? ~ M2 +k 


Finally, we substitute Equation 12.2.91 into Equation 12.2.87 and obtain 


kn Jo(knr) 
12.2.92 
x (M? + k2) Ji (kn)! ( ) 


Figure 12.2.7 illustrates various partial sums of this expansion. 


Special Functions 535 


1.2 


= 
oo 


I M 5 (M) 


Figure 12.2.7: A plot of Io(Mr)/Io(M) given by the Fourier-Bessel expansion Equation 12.2.92 for various 
partial summations when M = 1. 


We now develop an understanding of Bessel functions and how we can expand a well- 
behaved function in terms of J,,(-). Let us now apply them to solving various linear partial 
differential equations. 

e Example 12.2.9: Axisymmetric vibrations of a circular membrane 


'The wave equation 


1 Ou _ 3u | 10u 
e ðt? ðr? rr! 


0<r<a, 0<t (12.2.93) 


governs axisymmetric vibrations of a circular membrane, where u(r, t) is the vertical dis- 
placement of the membrane, r is the radial distance, t is time, c is the square root of the 
ratio of the tension of the membrane to its density, and a is the radius of the membrane. 
The conversion from rectangular to polar coordinates is given in Appendix A. We will solve 
Equation 12.2.93 when the membrane is initially at rest, u(r,0) = 0, and struck so that its 
initial velocity is 

ðu(r,0) _ Mb O<r<e, (12.2.94) 

Ot 0, e<r<a. 


If this problem can be solved by separation of variables, then u(r,t) = R(r)T(t). 
Following the substitution of this u(r, t) into Equation 12.2.93, separation of variables leads 


to 
1d dR 1 dT 
= = —k? 12.2.95 
rR dr (r dr ) c?T dt? , ( ) 
i d dR 
1 2p _ 
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and 5 

d^T 3:5 

We + k^c*T =0. (12.2.97) 
The separation constant —k? must be negative so that we obtain solutions that remain 
bounded in the region 0 < r < a and can satisfy the boundary condition. This boundary 
condition is u(a,t) = R(a)T(t) = 0, or R(a) = 0. 

The solutions of Equation 12.2.96 and Equation 12.2.97, subject to the boundary con- 

dition, are 


Ra(r) = (m) (12.2.98) 


where A, satisfies the equation Jo(A) = 0. Because u(r,0) = 0, and T,(0) = 0, Bn = 
Consequently, the product solution is 


~ n act 
u(r,t) = 163 sin(* E ) (12.2.100) 
= a a 
To determine An, we use the condition 
Ou(r,0) _ Ane 4 p 202) 2 d Pine’), OSr<e, (12.2.101) 
Ot a a 0, e«r«a 


Equation 12.2.101 is a Fourier-Bessel expansion using the orthogonal function Jo(A,r/a), 


where ‘ 5 e as ` 
aC nf 
A> = J d 12.2.102 

2 A7 aia sas a) n 


from Equation 12.2.63 and Equation 12.2.70. Carrying out the integration, 


2PJ1(A,e/a) 
fig od ENTRE 12.2.103 
enepAM2 J? (An) ( ) 
or 
_ 2P X Ji (Ane/a) Anr \ . f Anct 
u(r,t) — aa > RFO Jo a E | - (12.2.104) 


Figures 12.2.8, 12.2.9, and 12.2.10 illustrate the solution, Equation 12.2.104, for various 
times and positions when € = a/4, and € = a/20. They were generated using the MATLAB 
Script: 

% initialize parameters 

clear; eps_over_a = 0.25; M = 20; dr = 0.02; dt = 0.02; 

^ load in zeros of J0 

zero( 1) = 2.40483; zero( 2) 
zero( 4) = 11.79153; zero( 5) 
zero( 7) = 21.21164; zero( 8) 
zero(10) = 30.63461; zero(11) 
zero(13) = 40.05843; zero(14) 


5.52008; zero( 3) 8.65373; 
14.93092; zero( 6) = 18.07106; 
24.35247; zero( 9) = 27.49347; 
33.77582; zero(12) = 36.91710; 
43.19979; zero(15) = 46.34119; 
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Figure 12.2.8: The axisymmetric vibrations u'(r,t) = capu(r,t)/P of a circular membrane at various 


positions r/a at the times ct/a = 0, 0.2, 0.4, 0.6, 0.8, and 1 for e = a/4. Initially the membrane is struck 
by a hammer. 


SOLUTION 


TIME 


Figure 12.2.9: The axisymmetric vibrations capu(r, t)/ P of a circular membrane resulting from an initial 
hammer blow with e = a/4. The solution is plotted at various times ct/a and positions r/a. 


zero(16) 49.48261; zero(17) 52.62405; zero(18) = 55.76551; 
zero(19) 58.90698; zero(20) 62.04847; 
^4 compute Fourier-Bessel coefficients 
for m = 1:M 
a(m) = 2 * besselj(1,eps over a*zero(m)) 


/ (eps over a*pi*zero(m)*zero(m)*besselj(1,zero(m))^2); 
end 
R = [0:dr:1]; T = [0:dt:4]; 


538 Advanced Engineering Mathematics with MATLAB 


SOLUTION 


Figure 12.2.10: Same as Figure 12.2.9 except € = a/20. 


u = zeros(length(T) ,length(R)) ; 
RR = repmat(R,[length(T) 1]); 
TT = repmat(T?,[1 length(R)]); 
^4 compute solution from series solution 
for m= 1:M 
u = u + a(m) .* besselj(O,zero(m)*RR) .* sin(zero(m)*TT); 
end 
% plot results 
surf (RR,TT,u) 
xlabel(’R’,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel (’SOLUTION’ , ’Fontsize’ ,20) 
Figures 12.2.9 and 12.2.10 show that striking the membrane with a hammer generates a 


pulse that propagates out to the rim, reflects, inverts, and propagates back to the center. 
This process then repeats forever. 


e Example 12.2.10: Axisymmetric heat equation in an infinitely long cylinder 


In this example we illustrate how separation of variables can be employed in solving 
the axisymmetric heat equation in an infinitely long cylinder. In circular coordinates, the 
heat equation is 


(^ NO? rðr 


Ou E Ou 10u 
ot 


O<r<b, 0<t, (12.2.105) 


where r denotes the radial distance and a? denotes the thermal diffusivity. The conversion 
from rectangular to polar coordinates is given in Appendix A. Let us assume that we heated 
this cylinder of radius b to the uniform temperature To and then allowed it to cool by having 
its surface held at the temperature of zero starting from the time t = 0. 
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We begin by assuming that the solution is of the form u(r,t) = R(r)T(t) so that 


= = à 12.2.10 
R \ dr? T r dr a?T dt b2 ( e) 


1 (S5 1 =) 1 dT k? 
'The only values of the separation constant that yield nontrivial solutions are negative. The 
nontrivial solutions are R(r) = Jo(kr/b), where Jo(-) is the Bessel function of the first kind 
and zeroth order. A separation constant of zero gives R(r) = In(r), which becomes infinite 
at the origin. Positive separation constants yield the modified Bessel function lo(kr/b). 
Although this function is finite at the origin, it cannot satisfy the boundary condition that 
u(b,t) = R(b)T(t) = 0, or R(b) = 0. 

The boundary condition that R(b) — 0 requires that Jo(k) — 0. This transcendental 
equation yields an infinite number of constants kn. For each kn, the temporal part of the 
solution satisfies the differential equation 


dT, ka? 
— + 1T = 12.2.10 
dg 2 ( n 
which has the solution 
k2a? 
T, (t) = A, exp (- - r) : (12.2.108) 
Hence, the product solutions are 
k2 2 
us (r,t) = AnJo( kn ) exp (=) . (12.2.109) 


The total solution is a linear superposition of all of the particular solutions or 


(r,t) = Sa J (x z) S (12.2.110) 
u(r, S nJo( knz J exp 2 ; 2. 
Our final task remains to determine Ap. From the initial condition that u(r,0) = To, 
2 r 
de S An (ino) 12.2.111 
u(r, 0) 0 > Jo b ( ) 


From Equation 12.2.63 and Equation 12.2.70, 


= 2To b T -" 2To knr r b s 2To 
An = zo rAo(Faz.) dr = ( ) h(ka)| = EU) 22112) 


from Equation 12.2.27. Thus, the complete solution is 


3 1 r Erg" 
u(r,t) = m; Ea») ew( - 7 (12.2.113) 
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Figure 12.2.11: The temperature u(r, t)/To within an infinitely long cylinder at various positions r/b and 
times a?t/b? that we initially heated to the uniform temperature To and then allowed to cool by forcing its 
surface to equal zero. 


Figure 12.2.11 illustrates the solution, Equation 12.2.113, for various Fourier numbers 
a*t/b?. It was generated using the MATLAB script: 


clear 
M = 20; dr = 0.02; dt = 0.02; 
^ load in zeros of JO 
zero( 1) 2.40482; zero( 2) = 5.52007; zero( 3) = 8.65372; 
zero( 4) = 11.79153; zero( 5) = 14.93091; zero( 6) = 18.07106; 
zero( 7) = 21.21164; zero( 8) = 24.35247; zero( 9) = 27.49347; 
zero(10) = 30.63461; zero(11) = 33.77582; zero(12) = 36.91710; 
zero(13) = 40.05843; zero(14) = 43.19979; zero(15) = 46.34119; 
zero(16) = 49.48261; zero(17) = 52.62405; zero(18) = 55.76551; 
zero(19) = 58.90698; zero(20) = 62.04847; 
% compute Fourier coefficients 
for m= 1:M 

a(m) = 2 / (zero(m)*besselj(1,zero(m))); 
end 
^ compute grid and initialize solution 
R = [0:dr:1]; T = [0:dt:0.5]; 
u = zeros(length(T) , length (R)) ; 
RR = repmat(R,[length(T) 1]); 
TT = repmat(T’,[1 length(R)]); 
^4 compute solution from Equation 12.2.113 
for m= 1:M 

u = u + a(m)*besselj(0,zero(m)*RR).*exp(-zero(m)*zero(m)*TT); 
end 
surf (RR, TT,u) 
xlabel(’R’,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel(’SOLUTION’ , ’Fontsize’ ,20) 
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Heat flows from the interior and is removed at the cylinder’s surface where the temperature 
equals zero. The initial oscillations of the solution result from Gibbs phenomena because 
we have a jump in the temperature field at r — b. 


e Example 12.2.11: Heat conduction in an infinitely long, radiatively cooling cylinder 


In this example!? we find the evolution of the temperature field within a cylinder of 
radius b as it radiatively cools from an initial uniform temperature To. The conversion from 
rectangular to polar coordinates is given in Appendix A. The heat equation is then 


Ou» (S5 1 ðu 
a 


a 7s 2:3! Qx reb 0<t, (12.2.114) 


which we will solve by separation of variables u(r,t) = R(r)T(t). Therefore, 


des Ln 1d k 


} = = 12.2.11 
R \ dr? a?T dt b2’ ( 8) 


r dr 


because only a negative separation constant yields an R(r) that is finite at the origin and 
satisfies the boundary condition. This solution is R(r) = Jo(kr/b), where Jo(-) is the Bessel 
function of the first kind and zeroth order. 

The radiative boundary condition can be expressed as 


MOD Lib NSEC ES + nn) = 0. (12.2.116) 
Or dr 
Because T(t) Æ 0, 
one kJo(k) + hbJo(k) = —k Ji (k) + hbJo(k) = 0, (12.2.117) 


where the product hb is the Biot number. The solution of the transcendental equation, 
Equation 12.2.117, yields an infinite number of distinct constants k,. For each k,, the 
temporal part equals the solution of 


dT, ka? 
— + < = 12.2.118 
ag Pp ( 
or 
k2a? 
Talt) = An ew(- a r) . (12.2.119) 
The product solution is, therefore, 
k2 2 
unlr, t) = AnJo( kn ) ew(- a ) (12.2.120) 


and the most general solution is a sum of these product solutions 


2,2 
n 


= k 
u(r,t) = 3 AnJo(Fn =) exp(— a t). (12.2.121) 
n=1 


18 For another example of solving the heat equation with Robin boundary conditions, see Section 3.2 in 
Balakotaiah, V., N. Gupta, and D. H. West, 2000: A simplified model for analyzing catalytic reactions in 
short monoliths. Chem. Eng. Sci., 55, 5367-5383. 
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Figure 12.2.12: The temperature u(r,t)/To within an infinitely long cylinder at various positions r/b 
and times a?t/b? that we initially heated to the temperature Tp and then allowed to radiatively cool with 
hb — 1. 


Finally, we must determine An. From the initial condition that u(r, 0) = To, 


s T 
u(r,0) 2 Ty = p» AnJo(kn; ) (12.2.122) 
where 

2k2 To i r 275 knr ry |e 

An = ERRED A, OES) 7 ER ( b ) ^(«;)], 
(12.2.123) 
0 2knTodi(kn) __ 2knToJı (Kn) ___%nToi(kn) (52124) 

[k2 + bh?) Jolka) KRIS (kn) +h? JE (kn) — k2J& (kn) + RIE (Rn) 

= 2T Fi (kn) (12.2.125) 


kin [Jp (kn) + J? (kn)] 


which follows from Equation 12.2.27, Equation 12.2.63, Equation 12.2.73, and Equation 
12.2.117. Thus, the complete solution is 


- JA, T k2a? 
u(r,t) = m, CUBE EU Jo (Fn ) exp( n 7 (12.2.126) 


Figure 12.2.12 illustrates the solution, Equation 12.2.126, for various Fourier numbers 
a?t/b? with hb = 1. It was created using the MATLAB script: 
clear 
hb = 1; m=0; M = 100; dr = 0.02; dt = 0.02; 
^4 find kn which satisfies hb JO(k) = k J_1(k) 
for n = 1:10000 


Special Functions 543 


ki = 0.05*n; k2 = 0.05*(n*1) ; 
yl = hb * besselj(0,k1) - ki * besselj(1,k1); 
y2 = hb * besselj(0,k2) - k2 * besselj(1,k2); 


if yl*y2 <= 0; m = m*i; zero(m) = ki; end; 
end; 
^4 use Newton-Raphson method to improve values of kn 
for n = 1:M; for k = 1:5 

termo 


besselj(0,zero(n)); 
termi = besselj(1,zero(n)); 
term2 - besselj(2,zero(n)); 
f = hb * termO - zero(n) * termi; 
fp = O.5*zero(n)*(term2-termO) - (1*hb)*termi; 
zero(n) = zero(n) - f / fp; 
end; end; 
^4 compute Fourier coefficients 
for m= 1:M 
denom = zero(m)*(besselj(0,zero(m))^2*besselj(1,zero(m))^2); 
a(m) = 2 * besselj(1,zero(m)) / denom; 
end 
^4 compute grid and initialize solution 
R [0:dr:1]; T = [0:dt:0.5]; 
u 7 zeros(length(T),length(R)); 
RR = repmat(R,[length(T) 1]); 
TT = repmat(T?,[1 length(R)]); 
^4 compute solution from Equation 12.2.126 
for m= 1:M 
u = u + a(m)*besselj(0,zero(m)*RR).*exp(-zero(m)*zero(m)*TT); 


end 

surf (RR,TT,u) 

xlabel(’R’,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 

zlabel(’SOLUTION’ , ’Fontsize’ ,20) 

Heat flows from the interior and is removed at the cylinder’s surface where it radiates to 


space at the temperature zero. Note that we do not suffer from Gibbs phenomena here 
because there is no initial jump in the temperature distribution. 


e Example 12.2.12: Temperature within an electrical cable 


In the design of cable installations we need the temperature reached within an elec- 
trical cable as a function of current and other parameters. To this end,'? let us solve 
the nonhomogeneous heat equation in cylindrical coordinates with a radiation boundary 
condition. 

The derivation of the heat equation follows from the conservation of energy: 


heat generated = heat dissipated + heat stored, 


19 Iskenderian, H. P., and W. J. Horvath, 1946: Determination of the temperature rise and the maximum 
safe current through multiconductor electric cables. J. Appl. Phys., 17, 255-262. 
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or 


Ou 
Or 


2n(r + Ar) 


PRN dt = «[2nr u 
Ór 


| dt + 2nrArcp du, (12.2.127) 


T rtAr 


where J is the current through each wire, R is the resistance of each conductor, N is the 
number of conductors in the shell between radii r and r + Ar = 2mmrAr/(rb?), b is the 
radius of the cable, m is the total number of conductors in the cable, & is the thermal 
conductivity, p is the density, c is the average specific heat, and u is the temperature. In 
the limit of Ar > 0, Equation 12.2.127 becomes 


Ou a? ð Ou 
= ¢ Or 


< b t 12.2.128 
Ot r Or ) Der ss Bye rsen ( ) 


where A = I? Rm/(xU?cp), and a? = &/(pc). 

Equation 12.2.128 is the nonhomogeneous heat equation for an infinitely long, axisym- 
metric cylinder. Let us write the temperature as the sum of a steady-state and transient 
solution: u(r,t) = w(r) + v(r,t). The steady-state solution w(r) satisfies 


2 
ld (dw) A a wm A, (12.2.129) 
dr 4a? 


rdr a2’ 


where Te is the (yet unknown) temperature in the center of the cable. 
The transient solution v(r,t) is governed by 


Qv Ls rae 


2i "Or 


= < .2. 
3c c Jj O0<r<b, 0<t, (12.2.130) 


with the initial condition that u(r,0) = T. — Ar?/(4a?) + v(0,t) = 0. At the surface r = b, 
heat radiates to free space so that the boundary condition is up = —hu, where h is the 
surface conductance. Because the temperature equals the steady-state solution when all 
transient effects die away, w(r) must satisfy this radiation boundary condition regardless of 
the transient solution. This requires that 


A (b b 
T.—-—|(—-—l. 12.2.131 
a? (5 is x) ( ) 


Therefore, v(r,t) must satisfy v,(b,t) = —hv(b,t) at r = b. 
We find the transient solution v(r,t) by separation of variables v(r,t) = R(r)T(t). 
Substituting into Equation 12.2.130, 


1 d/ dR 1 dT ^ 
rRdr (« =)  aTd — "s VISA) 
UE df dR 
BA Erase 2.p — 
EE ¢ =) + k’rR=0, (12.2.133) 
and "m 
ant k?a?T = 0, (12.2.134) 


with R'(b) = —hR(b). The only solution of Equation 12.2.133 that remains finite at r = 
0 and satisfies the boundary condition is R(r) = Jo(kr), where Jo(-) is the zero-order 
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Bessel function of the first kind. Substituting Jo(kr) into the boundary condition, the 
transcendental equation is 
kbJı (kb) — hbJo(kb) = 0. (12.2.135) 


For a given value of h and b, Equation 12.2.135 yields an infinite number of unique zeros 
kn. 
The corresponding temporal solution to the problem is 


Tn(t) = An exp(—a? K2t), (12.2.136) 
so that the sum of the product solutions is 


v(r,t) = X` AnJo(knr) exp(—a? k2t). (12.2.137) 


n=1 
Our final task remains to compute An. By evaluating Equation 12.2.137 at t = 0, 


Ar? : 
v(r,0) = 75 -Te = 2, Andolha”), (12.2.138) 
which is a Fourier-Bessel series in Jo(knr). Earlier we showed how to compute the coefficient 
of a Fourier-Bessel series that is expanded in Jo(k,r) and that has a boundary condition of 


the form given Equation 12.2.135. Applying those results here, we have that 


> 


2k? 5 (Ar? 
"7 QU + hb?) JE (knb) / , (Ge E r.) Jolknr) dr (12.2.139) 


from Equation 12.2.63 and Equation 12.2.72. Carrying out the indicated integrations, 


Aes 2 | (= A Teka 


A 

(k2 n h2) J£ (b) Ja? EE, b ) J (kind) + ggz Jo (D) . (12.2.140) 
We obtained Equation 12.2.140 by using Equation 12.2.27 and integrating by parts as shown 
in Example 12.2.4. 

To illustrate this solution, let us compute it for the typical parameters b = 4 cm, hb = 1, 
a? = 1.14 cm?/s, A = 2.2747 °C/s, and T, = 23.94°C. The value of A corresponds to 37 
wires of #6 AWG copper wire within a cable carrying a current of 22 amps. 

Figure 12.2.13 illustrates the solution as a function of the radius at various times. It 
was created using the MATLAB script: 


clear 
asq = 1.14; A = 2.2747; b = 4; dr = 0.02; dt = 0.02; 
hb = 1; m=0; M = 10; T.c = 23.94; 
consti = A * b * b / (4 * asq); const2 = A * b * b / asq; 
const3 = A * b * b / (2 * asq); 
% find knb which satisfies hb J_O(kb) = kb J 1(kb) 
for n = 1:10000 

ki = 0.05*n; k2 = 0.05*(n*1) ; 

yl = hb * besselj(0,k1) - ki * besselj(1,k1); 

y2 = hb * besselj(0,k2) - k2 * besselj(1,k2); 

if yl*y2 <= 0; m = m*i; zero(m) = ki; end; 
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Figure 12.2.13: The temperature field (in degrees Celsius) within an electric copper cable containing 37 
wires and a current of 22 amperes at various positions r/b and times a?t/t? . Initially the temperature was 
zero and then we allow the cable to cool radiatively as it is heated. The parameters are hb — 1 and the 
radius of the cable b — 4 cm. 


end; 
^ use Newton-Raphson method to improve values of kn 
for n = 1:M; for k = 1:5 
term0 = besselj(0,zero(n)); 
besselj(1,zero(n)); 
term2 - besselj(2,zero(n)); 
f = hb * termO - zero(n) * termi; 
fp = O.5*zero(n)*(term2-termO) - (1+hb)*term1; 
zero(n) = zero(n) - f / fp; 


termi 


end; end; 

for m - 1:M 
denom = (zero(m)*zero(m)-*hb*hb)*besselj(0,zero(m))^2; 
a(m) = ((consti-T c) *zero(m) 


const2/zero(m))*besselj(1,zero(m)) 
+ const3 * besselj(0,zero(m)); 
2 x a(m) / denom; 


a(m) 
end 
^4 compute grid and initialize solution 
R [0:dr:1]; T = [0:dt:2]; 
u = T.c * ones(length(T) , Tength (R)) ; 
RR = repmat(R,[length(T) 1]); 
TT = repmat(T’,[1 length(R)]); 
% compute solution u(r,t) = w(r) + v(r,t) 
u = u - consti * RR .* RR; 
for m= 1:M 
u + a(m)*besselj(0,zero(m)*RR).*exp(-zero(m)*zero(m)*TT); 


[e] 
[i 


end 
surf(RR,TT,u); axis([O 1 O 2 O 25]); 
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xlabel(’R’ ,’Fontsize’,20); ylabel(’TIME’, ’Fontsize’ ,20) 
zlabel(’TEMPERATURE,~\circ C’,’Fontsize’ ,20) 


From an initial temperature of zero, the temperature rises due to the constant electrical 
heating. After a short period of time, it reaches its steady-state distribution given by 
Equation 12.2.129. The cable is coolest at the surface where heat is radiating away. Heat 
flows from the interior to replace the heat lost by radiation. 


e Example 12.2.13: Electrostatic potential inside a closed cylinder of finite length 


The electrostatic potential is defined as the amount of work that must be done against 
electric forces to bring a unit charge from a reference point to a given point. It is readily 
shown”? that the electrostatic potential is described by Laplace’s equation if there is no 
charge within the domain. Let us find the electrostatic potential u(r,z) inside a closed 
cylinder of length L and radius a. The base and lateral surfaces have the potential 0 while 
the upper surface has the potential V. 

Because the potential varies in only r and z, Laplace's equation in cylindrical coordi- 
nates reduces to 


198 / Ou 3u 
5 < L 12.2.141 
AE 0, 0<r<a, 0<z< L, ( ) 


subject to the boundary conditions u(a, z) = u(r,0) = 0, and u(r, L) = V. The conversion 
from rectangular to polar coordinates is given in Appendix A. To solve this problem by 
separation of variables,?! let u(r, z) = R(r)Z(z) and 


no mauu. (12.2.142) 


1 d/ dR\ _. 1 d?Z k? 
~ Z dæ a? 


Only a negative separation constant yields nontrivial solutions in the radial direction. In 


that case, we have that 
ld|( d x 
( =) i ue (12.2.143) 


T 
rdr\ dr a? 


The solutions of Equation 12.2.143 are the Bessel functions Jo(kr/a) and Yo(kr/ a). Because 
Yo(kr/a) becomes infinite at r = 0, the only permissible solution is Jo(kr/a). The condition 
that u(a,z) = R(a)Z(z) = 0 forces us to choose values of k such that Jo(k) = 0. Therefore, 
the solution in the radial direction is Jo(k,r/a), where kn is the nth root of Jo(k) = 0. 

In the z direction, 


PZ, k2 
aa ub LO (12.2.144) 


The general solution to Equation 12.2.144 is 


Zn(z) = An su (94) t B, JE (12.2.145) 
a a 


20 For static fields, V x E = 0, where E is the electric force. From Section 4.4, we can introduce a 
potential y such that E = Vy. From Gauss’ law, V. E = V?2y = 0. 


21 Wang and Liu [Wang, M.-L., and B.-L. Liu, 1995: Solution of Laplace equation by the method of 
separation of variables. J. Chinese Inst. Eng., 18, 731—739] have written a review article on the solutions 
to Equation 12.2.143 based upon which order the boundary conditions are satisfied. 
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Because u(r,0) = R(r)Z(0) = 0 and cosh(0) = 1, B, must equal zero. Therefore, the 
general product solution is 


= k k 
u(r,z) = Y, Ando (=) sinn (9) (12.2.146) 
mer a a 
The condition that u(r, L) = V determines the arbitrary constant A,. Along z = L, 
: kn bs. 
u(r,L) 2 V =~ Ando (=) sinh (=) , (12.2.147) 
per a a 
where i. 
kin L 2V knr 
inh| —— | A, = — Jo| —— | d 12.2.148 
(EE) ms f rn) ENSIS 


from Equation 12.2.63 and Equation 12.2.70. Since 


kaL 2V knr knr 2V 
inh| —— | A, = ————— —— 12.2.149 
ds ( a ) Tr e a jae a ).- TOES 
the solution is then 
(k h(k 
(r,z ELO» Jol s Sub ue p) (12.2.150) 


knJı(kn) sinh(k, L/a) 


Figure 12.2.14 illustrates Equation 12.2.150 for the case when L — a where we included 
the first 20 terms of the series. It was created using the MATLAB script: 


clear 
L_over_a = 1; M = 20; dr = 0.02; dz = 0.02; 
^ load in zeros of J0 
zero( 1) 2.40482; zero( 2) = 5.52007; zero( 3) = 8.65372; 
zero( 4) = 11.79153; zero( 5) = 14.93091; zero( 6) = 18.07106; 
zero( 7) = 21.21164; zero( 8) = 24.35247; zero( 9) = 27.49347; 
zero(10) = 30.63461; zero(11) = 33.77582; zero(12) = 36.91710; 
zero(13) = 40.05843; zero(14) = 43.19979; zero(15) = 46.34119; 
zero(16) = 49.48261; zero(17) = 52.62405; zero(18) = 55.76551; 
zero(19) = 58.90698; zero(20) = 62.04847; 
% compute Fourier coefficients 
for m= 1:M 

a(m) = 2/(zero(m)*besselj(1,zero(m))*sinh(L over a*zero(m))); 
end 
^4 compute grid and initialize solution 
R_over_a = [0:dr:1]; Z over.a = [0:dz:1]; 
u = zeros(length(Z over a) ,length(R over a)); 
RR over. a = repmat(R over a,[length(Z over a) 1]); 
ZZ. over.a = repmat(Z_over_a’,[1 length(R over. .a)]); 
^4 compute solution from Equation 12.2.150 
for m= 1:M 

u-uta(m).*besselj(O,zero(m)*RR over a) .* sinh(zero(m)*ZZ over a); 
end 
surf (RR over.a,ZZ over.a,u) 
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U(R,Z) 


</A us RIA 


Figure 12.2.14: The steady-state potential (divided by V) within a cylinder of equal radius and height a 
when the top has the potential V while the lateral side and bottom are at potential 0. 


xlabel(’R/A’,’Fontsize’ ,20); ylabel(’Z/A’,’Fontsize’ ,20) 
zlabel(’U(R,Z)’,’Fontsize’ ,20) 


Of particular interest are the ripples along the line z = L. Along that line, the solution must 
jump from V to 0 at r =a. For that reason our solution suffers from Gibbs phenomena 
along this boundary. As we move away from that region, the electrostatic potential varies 
smoothly. 


e Example 12.2.14: Electrostatic potential inside a closed cylinder of finite length 


Let us now consider a similar, but slightly different, version of Example 12.2.13, where 
the ends are held at zero potential while the lateral side has the value V. Once again, the 
governing equation is Equation 12.2.141 with the boundary conditions u(r, 0) = u(r, L) = 0 
and u(a, z) = V. 

Separation of variables yields 


1 d/ dR DIdPE k 
rRdr (« T) |» Zd2 P a ator 


with Z(0) = Z(L) = 0. We chose a positive separation constant because a negative con- 
stant would give hyperbolic functions in z that cannot satisfy the boundary conditions. A 
separation constant of zero would give a straight line for Z(z). Applying the boundary 
conditions gives a trivial solution. Consequently, the only solution in the z direction that 
satisfies the boundary conditions is Z,,(z) = sin(nmz/L). 

In the radial direction, the differential equation is 


rdr r dr 


1d / dR, 252 
( x) LUN ES (12.2.152) 
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As we showed earlier, the general solution is 


NTT NTT 


R,(r) = Anto(“*) + B„Ko( =) (12.2.153) 


where Io(-) and Ko(-) are modified Bessel functions of the first and second kind, respectively, 
of order zero. Because Ko(r) behaves as — ln(x) as x — 0, we must discard it and our 
solution in the radial direction becomes R,,(r) = A,Io(nzr/L). Hence, the product solution 


1S 


un(r, z) = Anto(“*) sin(“*) (12.2.154) 


and the general solution is a sum of these particular solutions, namely 


u(r, z) = 5 AsJo( =) sin(*72) l (12.2.155) 
n=1 


Finally, we use the boundary conditions that u(a,z) = V to compute A,. This condition 
gives 


u(a,z)=V = x Anlo( 7) sin( Z5) l (12.2.156) 
so that 5 4 
(^) Age if V sin(“**) dz = oe Cu" (12.2.157) 
0 


Therefore, the final answer is 


oo 


O AV Io|(2m — 1)zr/L]sin|(2m — 1)zz/LJ] 
UR) v e (2m-1MHo(2m-1)ma/L] ` 


(12.2.158) 


m=1 


Figure 12.2.15 illustrates the solution, Equation 12.2.158, for the case when L = a. It 
was created using the MATLAB script: 


clear 

a_over_L = 1; M = 200; dr = 0.02; dz = 0.02; 

^4 compute grid and initialize solution 

R_over_L = [0:dr:1]; Z_over_L = [0:dz:1]; 

u = zeros(length(Z_over_L) , length(R_over_L)) ; 
RR_over_L = repmat(R_over_L, [length(Z_over_L) 1]); 
ZZ_over_L = repmat(Z_over_L’,[1 length(R_over_L)]); 


for m = 1:M 
temp = (2*m-1)*pi; prodi = temp*a_over_L; 
% compute modified Bessel functions in Equation 12.2.158 
for j = 1:length(Z_over_L); for i = 1:length(R over L); 
prod2 = temp*RR over L(i,j); 
if prod2 - prodi > -10 
if prod2 « 20 
ratio(i,j) = besseli(0,prod2) / besseli(0,prod1) ; 
else 
^ for large values of prod, use asymptotic expansion 
4 for modified bessel function 
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SOLUTION 


21 0 0 ev 


Figure 12.2.15: Potential (divided by V) within a conducting cylinder when the top and bottom have a 
potential 0 while the lateral side has a potential V. 


ratio(i,j) = sqrt(prodi/prod2) * exp(prod2-prod1); end; 
else 
ratio(i,j) = 0; end 
end; end; 
^4 compute solution from Equation 12.2.158 
u = u + (4/temp) * ratio .* sin(temp*ZZ over L) ; 
end 
surf (RR over .L,ZZ over.L,u) 
xlabel(C R/L?,?Fontsize?,20); ylabel(’Z/L’, ’Fontsize’ ,20) 
zlabel (’SOLUTION’ , ’Fontsize’ ,20) 
Once again, there is a convergence of equipotentials at the corners along the right side. If 
we had plotted more contours, we would have observed Gibbs phenomena in the solution 
along the top and bottom of the cylinder. 


e Example 12.2.15: Electrostatic potential inside a closed cylinder of semi-infinite length 


In the previous examples, the domain was always of finite extent. Assuming axial 
symmetry, let us now solve Laplace’s equation 


10 / ðu 0?u 
| = < 2. 
-x ra) 528 0, O<r<w, 0«z«oo, (12.2.159) 


in the half-plane z > 0 subject to the boundary conditions 


uo, T «d, 


Jm |u(r, z)| < oo, u(r,0) — { 0, pid. (12.2.160) 
lim |u(r, z)| < oo; and lim |u(r, z)| < oo. (12.2.161) 
r—0 T—00 


This problem gives the steady-state temperature distribution in the half-space z > 0 where 
the temperature on the bounding plane z = 0 equals ug within a circle of radius a and 
equals 0 outside of the circle. 
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As before, we begin by assuming the product solution u(r, z) = R(r)Z(z) and separate 
the variables. Again, the separation constant may be positive, negative, or zero. Turning 
to the positive separation constant first, we have that 


R" 1 R’ u Aus j 


pu ree "m (12.2.162) 
Focusing on the R equation, 
m + ioe m? —0, or r?'R'--rR- m?^r?R — 0. (12.2.163) 
R rR 
The solution to Equation 12.2.163 is 
R(r) = Ai lo(mr) + As Ko(mr), (12.2.164) 


where Io(-) and Ko(-) denote modified Bessel functions of order zero and the first and second 
kind, respectively. Because u(r,z), and hence R(r), must be bounded as r — 0, A» = 0. 
Similarly, since u(r, z) must also be bounded as r > oo, A4 = 0 because limpo Jo(mr) > 
oo. Thus, there is only a trivial solution for a positive separation constant. 

We next try the case when the separation constant equals 0. This yields 


R" 1 R’ 
a ae 0, or r?R" - rR — 0. (12.2.165) 
The solution here is 
R(r) = Ay + As In(r). (12.2.166) 


Again, boundedness as r — 0 requires that A9 = 0. What about Ai? Clearly, for any 
arbitrary value of z, the amount of internal energy must be finite. This corresponds to 


n |u(r,z)) dr «oo or n | R(r)| dr < oo (12.2.167) 
0 0 


and A, — 0. The choice of the zero separation constant yields a trivial solution. 
Finally, when the separation constant equals —k?, the equations for R(r) and Z(z) are 


rR"  rR -- k?r? R — 0, and | Z"—Kk?Z — 0, (12.2.168) 
respectively. Solving for R(r) first, we have that 
R(r) = AyJo(kr) + AsYo(kr), (12.2.169) 
where Jo(-) and Yo(-) denote Bessel functions of order zero and the first and second kind, 
respectively. The requirement that u(r, z), and hence R(r), is bounded as r — 0 forces us 
to take Aj = 0, leaving R(r) = Ai Jo(kr). From the equation for Z(z), we conclude that 


Z(z) = Bie"? + Bye. (12.2.170) 


Since u(r, z), and hence Z(z), must be bounded as z — oo, it follows that Bı = 0, leaving 
Z(z) = Be., 
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Presently our analysis follows closely those for a finite domain. However, we have 
satisfied all of the boundary conditions and yet there is still no restriction on k. Hence, we 
conclude that k is completely arbitrary and any product solution 


ux(r, z) = A,B Jo(kr) e^ ^* (12.2.171) 


is a solution to our partial differential equation and satisfies the boundary conditions. From 
the principle of linear superposition, the most general solution equals the sum of all of the 
possible solutions, or 


u(r, z) = ie A(k) k Jo(kr) e~** dk, (12.2.172) 


where we have written the arbitrary constant A,B as A(k)k. Our final task remains to 
compute A(k). 

Before we can find A(k), we must derive an intermediate result. If we define our Fourier 
transform in an appropriate manner, we can write the two-dimensional Fourier transform 
pair as 


fle,y) = g- f J F(k, £) é~) dk de, (12.2.173) 
T J—oo J—oo 


where í ee 
F(k,0) = 5- / J Fla, y) e 1*9 dz dy. (12.2.174) 
T J—oo J—oo 


Consider now the special case where f(x,y) is only a function of r = 4/2? + y?, so that 
f(x,y) = g(r). Then, changing to polar coordinates through the substitution x = r cos(0), 
y-—rsin(0), k = pcos(o), and £ = psin(y), we have that 


kx + £y = rp|cos(0) cos(q) + sin(@) sin(y)] = rpcos(0 — v), (12.2.175) 
and 
dA = dz dy = r dr dé. (12.2.176) 
Therefore, the integral in Equation 12.2.174 becomes 
1 oo 2T , 
F(k,£) = — Í g(r) e~7P 89-9) » dr do (12.2.177) 
27 Jo Jo 
1 oo 2T ] 
—— [| rg(r) / epee) i dr. (12.2.178) 
2m Jo 0 


If we introduce A = 0 — y, the integral 


Qn 2:-9 —— OT. A 
I e ire cos(0— 4) dó = / e ire cos(A) d\= y e ire cos(A) d\ = 27 Jo(pr). 
0 =p B 
(12.2.179) 


The third integral in Equation 12.2.179 is equivalent to the second integral because the 
integral of a periodic function over one full period is the same regardless of where the inte- 
gration begins. The final result follows from the integral definition of the Bessel function.?? 
Therefore, 


F(k,£) = [rae Jo(pr) dr. (12.2.180) 


22 Watson, G. N., 1966: A Treatise on the Theory of Bessel Functions. Cambridge University Press, 
Section 2.2, Equation 5. 
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Finally, because Equation 12.2.180 is clearly a function of p = Vk? + (2, F(k,£) = G(p) 
and 


G(p) = E r g(r) Jo(pr) dr. (12.2.181) 


Conversely, if we begin with Equation 12.2.173, make the same substitution, and inte- 
grate over the ké-plane, we have that 


1 oo 2n ; 
f(z,y) = g(r) = x] I F(k, £) eir? 0-9) 5 dp dio (12.2.182) 
0 0 
1 oo 2m f 
=— | pG(p) | eirecos(ó—e) do| dp (12.2.183) 
2m 0 0 
=} p G(p) Jo(pr) dp. (12.2.184) 
0 


Thus, we obtain the result that if f^" |F(r)| dr exists, then 


g(r) = [ecw Jo(pr) dp, (12.2.185) 


where 
G(p) = 1 r g(r) Jo(pr) dr. (12.2.186) 


Taken together, Equation 12.2.185 and Equation 12.2.186 constitute the Hankel transform 
pair for Bessel function of order 0. The function G(p) is called the Hankel transform of 


g(r). 
Why did we introduce Hankel transforms? First, setting z = 0 in Equation 12.2.172, 
we find that 


u(r,0) = j^ A(k) k Jo (kr) dk. (12.2.187) 


If we now compare Equation 12.2.187 with Equation 12.2.185, we recognize that A(k) is 
the Hankel transform of u(r, 0). Therefore, 


a 


A(k) = I ru(r,0) Jo(kr) dr = w f r Jo(kr) dr = Tr Ji(kr) = TJ. (Ra). 
0 0 0 


(12.2.188) 
For this reason, the complete solution is 


u(r,z) = avo | Jı (ka) Jo(kr) e~** dk. (12.2.189) 
0 
Figure 12.2.16 illustrates Equation 12.2.189. 


Problems 


1. Show from the series solution that 


dz 
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Figure 12.2.16: The axisymmetric potential u(r, z)/uo in the half-space z > 0 when u(r,0) = ug ifr < a 
and u(r,0) — 0 ifr >a. 


From the recurrence formulas, show the following relations: 
2. Si (x) = Jo(x) — Jo(x) 3. Jo(x) = Jo (x) — Jo(x)/x 


4. 


A6) = 299 (3-1) ho 


5. 

Jn(v) 1  Jo(v) 2 Jol) _ 2 , Jo(z) 

A) æ Ja) z Ale) | Jo(z) 
y 48 8 24 

Ja(z) = (5 — =) Ji (a) — E — i) Jo(x) 
7. 
Ja+2(£) = [m -1 m 2 Jala) - 2(n + 1)J/ (a) 
8. " 
Ja(x) = (3 rm 1) Ji (x) oa —Jo(x) 

9. 


4J! (x) = In—2(x) — 2J4 (x) + Jno (£) 


10. Show that the maximum and minimum values of J4,(x) occur when 


nJ, (x) e: NJ n(x) 
Jn4i(z)' Jn-i(x)' 


qi = 


and Js 1(x) = Jag (x). 
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Show that 
11. à 
E [x7 J3(2x)] = ~x J3 (2x) + 2x7 Ja (2) 
12. F 
— [zJo(2?)] = Jo(z?) — 22?J1 (x°) 
dx 
13. 
] ERG») dx = $23 J3(3z) + C 
14. 
] ^e» dx = —iz ?Jó4(2x)-- C 
15. 
fe In(z)Jo(x) dz = Jo(z) + zIn(z)Ji(x) + C 
16. " 
A k 
f zJo(kz) dz = cdi) 
17. 
i , 4 2 
0 
18. 
1 2 2 = 4 2 
0 
19. Show that 
Jo (Hest) 
ped y WI ë o<gr<l, 
2 Hk Ji (uk) 


where up is the kth positive root of Jo(u) = 0. Then use MATLAB to illustrate various 
partial sums of the Fourier-Bessel series. 


20. Show that 
zo 0<2x<1, 


where uj is the kth positive root of Jo(u) = 0. Then use MATLAB to illustrate various 
partial sums of the Fourier-Bessel series. 
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21. Show that 


us Ji (uia) 
4 3 — —16 0czr«2, 
EE P ON 


where up is the kth positive root of J;(24) = 0. Then use MATLAB to illustrate various 
partial sums of the Fourier-Bessel series. 


22. Show that 


where up is the kth positive root of Jı(u) = 0. Then use MATLAB to illustrate various 
partial sums of the Fourier-Bessel series. 


23. Show that 


z= ay Be e 0 € z « 1, 
kel (ug — 1)J: Lr) 


where ju, is the kth positive root of Ji(u) = 0. Then use MATLAB to illustrate various 
partial sums of the Fourier-Bessel series. 


24. Show that 


)Jo(Urx) 
1-24 -5 (i qun) 0Zz&l, 
k=1 pA (He) 


where uj is the kth positive root of Jo(u) = 0. Then use MATLAB to illustrate various 
partial sums of the Fourier-Bessel series. 


25. Show that 


Jo(uxx/L) 
1=2aL 0<ar<L 
e: 3 (u2 + a2 L2)Jo(ux)" Tb ES 


where px is the kth positive root of uJi(u) = oLJo(pu). Then use MATLAB to illustrate 
various partial sums of the Fourier-Bessel series. 


26. Using the relationship?? 


aBJ, (aa)J, (Ba) — aaJ, (Ga) J! (aa) 
= 82 ? 


[ J,(ar)J,(Br) r dr = 
0 


show that 


Jo(bx:) = Jo (ba) i 2b? Y Jo (UK) 0 
Jo(ba) a £— pg (uy — b?) Si (uea)’ SUE 


where up is the kth positive root of Jo(ua) = 0 and b is a constant. 


?3 Watson, op. cit., Section 5.11, Equation 8. 
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27. Given the definite integral? 
1 x Jo(bz) _ sin(b) 
dx i 0 « b, 
v1- xz? b 


show that 


H (t — x) D» sin(Upt) Jo(pua) 


; 0<a<1, 0<t<1, 
= = Un JZ (ue) 


where up is the kth positive root of Jo(u) = 0 and H(-) is Heaviside's step function. 


28. Using the same definite integral from the previous problem, show?? that 


; 0<2<b, 


H(a — x) sin(Una/b) Jo (fina /b) 
= =; > 


a? — " UnJê( (un) 
where a < b, un is the nth positive root of Jå(u) = 0, and H(-) is Heaviside’s step function. 


29. Given the definite integral?? 


a a1 A/hb2 2 
| cos(ez) Jo(bv/at — a?) ax = OEE) aei 


0 V0? + c? 
show that 
wem m) e 2 sin (tuz — 9 ) Jo(ue) 
Gy = 
guy ac vuU J? (ura) 


where 0 < x < a, uk is the kth positive root of Jo(ua) = 0, H(-) is Heaviside's step function, 
and b is a constant. 


30. Using the integral definition of the Bessel function?’ for Jı (z): 


2 [!tsin(zt) 


vV1—-t? 


A(2) = 0«z, 


show that 


x T nnt NTL 
IVE x? dew) LX T) pe eus 


24 Gradshteyn, I. S., and I. M. Ryzhik, 1965: Table of Integrals, Series, and Products. Academic Press, 
Section 6.567, Formula 1 with v = 0 and u = —1/2. 


?5 See Wei, X. X., 2000: Finite solid circular cylinders subjected to arbitrary surface load. Part II- 
Application to double-punch test. Int. J. Solids Struct., 37, 5733-5744. 


?6 Gradshteyn and Ryzhik, op. cit., Section 6.677, Formula 6. 


27 Gradshteyn and Ryzhik, Ibid., Section 3.753, Formula 5. 


Special Functions 559 


where H(.) is Heaviside's step function. Hint: Treat this as a Fourier half-range sine 
expansion. 


31. Show that 


M n E olla UD (eco <0: 


where up is the kth positive root of Jo(u) = 0 and ó(-) is the Dirac delta function. 


32. Show that 


Jo GI 
2nx x dri dol 


where up is the kth positive root of Jo(u) = 0 and ó(-) is the Dirac delta function. 
Separation of Variables Solution to the Wave Equation 


33. Solve?? the wave equation 


3u o ðu 
-e < 
E xx). 0zrc«l, 0 « t, 


subject to the boundary conditions lim;.,o |u(z,t)| < oo, u(1,t) = 0, 0 < t, and the initial 


conditions 9 
u(z,0)=0, O<a<1, 2 -1 


T 0<2<a, 
0, a<a«<l, 


where a < 1. Hint: Use the substitution 4x = r?. 
Separation of Variables Solution to the Heat Equation 


34. Solve?? the heat equation in cylindrical coordinates 


Ou (u 1du 
Ot e (Sate), De soup. SOE 


subject to the boundary conditions lim,_s9 |u(r,t)| < oo, and u(b,t) = ug, 0 < t, and the 
initial condition u(r,0) — 0, 0 € r <b. 


35. Solve the heat equation in cylindrical coordinates 


ðu a 3 / Ou 
-— « 
ET xx) O<r<b, Oct, 


subject to the boundary conditions lim,.,o |u(r,t)| < oo, and u(b,t) = 0, 0 < t, and the 
initial condition u(r,0) — 1, 0 € r <b. 


28 Solved in a slightly different manner by Bailey, H., 2000: Motions of a hanging chain after the free 
end is given an initial velocity. Am. J. Phys., 68, 764-767. 


?9 See Destriau, G., 1946: Propagation des charges électriques sur les pellicules faiblement conductrices 
“problém plan." J. Phys. Radium, 7, 43-48. 
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36. Solve the heat equation in cylindrical coordinates 


Ou C2 x 


z "Or 


= < 
J T ). 0<r<1, 0<t, 


subject to the boundary conditions lim,.,o |u(r,t)| < co, and u(1,t) = 0, 0 < t, and the 
initial condition 

i= A, O0<r<b, 
"^ B, b «r «1. 


37. 'The equation?? 


Ou G Ou 10u b 

mea Sau (Ft, O<r<b, Oct, 

governs the velocity u(r,t) of an incompressible fluid of density p and kinematic viscosity 
v flowing in a long circular pipe of radius b with an imposed, constant pressure gradient 
—G. If the fluid is initially at rest, u(r, 0) = 0, 0 € r < b, and there is no slip at the wall 
u(b,t) — 0, 0 « t, find the velocity at any subsequent time and position. Hint: First find 
the steady-state solution w(x) and then write u(x,t) = w(x) + v(z, t), where v(z,t) is the 
transient solution so that u(x,t) satisfies the initial condition. 


38. Solve the heat equation in cylindrical coordinates 


Ou að / ðu 
ot xx) iM Uen 
subject to the boundary conditions lim,.,o |u(r,t)| < oo, and u,(b,t) = —h u(b,t), 0 < t, 


and the initial condition u(r,0) = b? — r?°, 0 € r <b. 
39. Solve?! the heat equation in cylindrical coordinates 


Ou o/u 10u 

E gel ee dec cs «r«L 

En (5: -x) KAL, O<r<L, 0<t, 

subject to the boundary conditions lim,_,9 |u(r,t)| < co, and u,(L,t) = —hu(L,t), 0 < t, 


and the initial condition 
troie 0, O0<r<b, 
j E To, b<r< L, 


where b < L, and 0 < h,K. Hint: Introduce u(r,t) = e^ ^*v(r, t). 


40. Use separation of variables to solve?? the partial differential equation 


ðu — (m u 


MIA V i < 
Ot ðr? or Or i) QS n e 


30 See Szymanski, P., 1932: Quelques solutions exactes des équations de l’hydrodynamique du fluide 
visqueux dans le cas d'un tube cylindrique. J. Math. Pures Appl., Ser. 9, 11, 67-107. 


31 Mack, W., M. Plóchl, and U. Gamer, 2000: Effects of a temperature cycle on an elastic-plastic shrink 
fit with solid inclusion. Chinese J. Mech., 16, 23-30. 


32 See Littlefield, D. L., 1991: Finite conductivity effects on the MHD instabilities in uniformly elongating 
plastic jets. Phys. Fluids, Ser. A, 3, 1666-1673. 
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subject to the boundary conditions that lim, 9 |u(r, t)| < oo, u(1,t) = K, 0 < t, and the 
initial condition that u(r,0) = g(r), 0 « r « 1. 


Step 1: Setting u(r,t) 2 Kr + v(r,t), show that the problem becomes 


Ov ,(0v 10v v 
— = } < 
Ot (53 ) O<r<l, 0<t, 


ror r? 


subject to the boundary conditions that lim, ,o |v(r,t)| < oo, v(1,t) = 0, 0 < t, and the 
initial condition that u(r,0) = g(r) - Kr, 0 « r « 1. 

Step 2: Assuming that v(r,t) — R(r)T(t), show that the problem reduces to the ordinary 
differential equations 


1 1 
R" +R + CEEJEZD 
T T 


and 


T' -a?k?T — 0 


with the boundary conditions lim,_,9 | R(r)| < oo and R(1) = 0, where k? is the separation 
constant. 


Step 3: Solving the eigenvalue problem first, show that R,(r) = Jı (knr) where k, denotes 
the nth root of J;(k) = 0 and n = 1,2,3,.... 


Step 4: Show that T, (t) = An,e~® Fat so that 


v(r,t) = 5 AnJilknrje 9 st, 


n=1 


Step 5: Using the initial condition, show that 


v(r,0) = g(r) - Kr = 5 An Jı (knr). 


n=1 
Step 6: Evaluate A, and show that it equals 
A 2 [x+ En [ $26 jrd 
n = T nr) rar 
kn Jolka) ned h d e 


41. A thermometer measures temperature by the thermal expansion of a liquid (usually 
mercury or alcohol) stored in a bulb into a glass stem containing an empty cylindrical 
channel. Under normal conditions, temperature changes occur sufficiently slowly so that 
the temperature within the liquid is uniform. However, for rapid temperature changes 
(such as those that would occur during the rapid ascension of an airplane or meteorological 
balloon), significant errors could occur. In such situations the recorded temperature would 
lag behind the actual temperature because of the time needed for the heat to conduct in or 
out of the bulb. During his investigation of this question, McLeod?? solved 


Ou Cr 


Ot cS r Or e 


Ji 0xr«b, Oct, 


33 McLeod, A. R., 1919: On the lags of thermometers with spherical and cylindrical bulbs in a medium 
whose temperature is changing at a constant rate. Philos. Mag., Ser. 6, 37, 134-144. See also Bromwich, 
T. J. PA., 1919: Examples of operational methods in mathematical physics. Philos. Mag., Ser. 6, 37, 
407-419; McLeod, A. R., 1922: On the lags of thermometers. Philos. Mag., Ser. 6, A3, 49—70. 
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subject to the boundary conditions lim,. o |u(r, t)| < co, and u(b, t) = y(t), 0 < t, and the 
initial condition u(r,0) = 0, 0 € r <b. The analysis was as follows: 


Step 1: First solve the heat conduction problem 


dA að f ðA 
= < 
E" Tx) O<r<b, Oct, 


subject to the boundary conditions lim,_,9 |A(r,t)| < oo, and A(b,t) = 1, 0 < t, and the 
initial condition A(r, 0) 2 0, 0 € r « b. Show that 


A(r, t) iiy M pue dm) ELM 
1( 


where Jo(k,,) = 0. 
Step 2: Use Duhamel’s theorem (see Section 9.4) and show that 
2a? C kn Jolknr/b) ft 242 2 
H= n n —a^k;(t—T)/b dr. 
ur.) = Fe oe f eoe r 


n=1 


Step 3: If y(t) = Gt, show that 


Jo( (k nr/b) i p? —a? k? t/b2 
u(r, t) -16l kn, Jic 2 T a?k2 (e nt/ -1) x 


McLeod found that for a mercury thermometer of 10-cm length a lag of 0.01? C would 
occur for a warming rate of 0.032°C s^! (a warming gradient of 1.9°C per thousand feet 
and a descent of one thousand feet per minute). Although this is a very small number, 
when he included the surface conductance of the glass tube, the lag increased to 0.85?C. 
Similar problems plague bimetal thermometers?^ and thermistors?? used in radiosondes 
(meteorological sounding balloons). 


Separation of Variables Solution to Laplace’s Equation 


42. Solve 
Ou 10u u 


Or? 2 r Or T 0z? 
with limo |u(r, z)| < oo, u(a,z) = 0, =L < z < L and u;(r, -L) = u;(r,L) = 1, 
0 « r « a. 


— 0, O<r<a, -L<z< lL, 


43. During their study of the role that diffusion plays in equalizing gas concentrations 
within that portion of the lung that is connected to terminal bronchioles, Chang et al.°° 


solved Laplace’s equation in cylindrical coordinates 


0?u , 10u x Ou 
ðr? rr | 0z2 


— 0, O<r<b, -L«zc«L, 


34 Mitra, H., and M. B. Datta, 1954: Lag coefficient of bimetal thermometer of chronometric radiosonde. 
Indian J. Meteorol. Geophys., 5, 257—261. 


35 Badgley, F. L, 1957: Response of radiosonde thermistors. Rev. Sci. Instrum., 28, 1079-1084. 


36 Chang, D. B., S. M. Lewis, and A. C. Young, 1976: A theoretical discussion of diffusion and convection 
in the lung. Math. Biosci., 29, 331—349. 
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subject to the boundary conditions that lim, 5o |u(r, z)| < œ, u.(b,z) = 0, -L < z < L, 
and 


Qur,-L) Ou(L) [A  0<r<a, 
Oz |» ——0z | |0, a «r «b. 
What should they have found? 
44. Solve?” " 5 m 
u lôu u 
| = < 
32 trop Bg 0, 0<r<b, 0<z< L, 


with the boundary conditions lim, 59 |u(r, z)| < oo, ur(b, z) = 0, 0 < z < L, and 


Ou(r, 0) lo 0<r<a, u(r, L) = A, 0xr b. 


Oz 0, a<r<b, 
45. Solve E ia E 
u u u 
| = < h 
mod a Um 0, O<r<a, 0<2<h, 
with the boundary conditions lim,_,9 |u(r, z)| < oo, ur(a, z) = 0, 0 < z < h, and 
ðu(r,0) [35 0 € r « ro, 
u(r, h) = 0, 0<r<a, 5z a ree oa. 
46. Solve ga 5 ga 
1 
i i: Hi, O<r<l, 0<z<d, 


Dp aE On am 


with the boundary conditions lim,_,9 |u(r, z)| < oo, u,(1, z) 2 0, 0< z < h, and 


Ou(r, 0) —1, O<r<a, barel 
Oz cg VESTES use) = { 4 92 Lu a «r «b. 
47. Solve®® - - j 
d A = 0, 0<r<1, 0<z<1. 


ôr? rür mr O02 
Take for the boundary conditions either (a) lim,_,9 |u(r, z)| < oo, u(1,z) = -1,0«z < 1, 
and uz(r,0) = u(r,1) = 0,0 < r < 1; or (b) lim,_49 Ju(r, z)| «oo, u(1,z) 20,0«z« 1, 
and uz(r,0) = 0, u(r, 1) =r,0<r<l. 


48. Solve 
Ou 10u u l Oru 
ðr? rmrOr rr? O22 


with lim,_,9 |u(r, z)| < oo, u(a, z) 20,0 < z < h, and u(r,0) = 0, uz(r,h) = Ar,O< r « a. 


= 0, O<r<a, 0<z<h, 


37 See Keller, K. H., and T. R. Stein, 1967: A two-dimensional analysis of porous membrane transfer. 
Math. Biosci., 1, 421—437. 


38 See Muite, B. K., 2004: The flow in a cylindrical container with a rotating end wall at small but finite 
Reynolds number. Phys. Fluids, 16, 3614-3626. 
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49. Solve 
Ou lôu u l 0?u = 
Ər? r Or vr? 82 — 


with lim,.,o |u(r, z)| < oo, u(a,z) 2z, 0 < z < 1, and u(r,0) = u(r, 1) 20,0 € r « a. 


0, O<r<a, 0<z<1, 


50. Solve 
3u 1 ðu u Ou 7 
Or? r Or 72 02 — 


with lim;.,o |u(r, z)| < oo, u.(a,z) 20,0 <z < h, and u(r,0) 20, u;(r,h) 2r, 0€ r « a. 


0, O<r<a, 0<2z<h, 


51. Solve 
u lôu u Ou 


ôr? rôr r O2 


with the boundary conditions lim,.,o |u(r, z)| < oo, ur(1,z) = u(1,z), —a < z < a, and 
—u;(r,-a)- uz(r,a) =r, 0 <r <1. 


0, 0<r<1, -a<z<a, 


52. Solve’? 
Oru E Lou | 0?u 
Or? rOr | Oz? 
subject to the boundary conditions that lim, ,o |u(r, z)| < oo, u.(1,z) = —hu(1,2), 0 < 
z < L, and u(r,0) = uo, u(r, D) 20, 0 <r < 1, using the Fourier-Bessel series 


u — 0, 0<r<1, 0<z<L 


u(r, z) = X` AnZn(z)Jo(knr), 


where kn is the nth root of k Ji(k) + h Jo(k) = h Jo(k) — k Jı (k) = 0. 
53. Solve? Laplace’s equation in cylindrical coordinates 


LM 19u _ Ou - 
ðr? rðr Oz? — 


0, Ü rege ders 


subject to the boundary conditions that lim,.,o|u(r,z)| < oo, —Du,(a,z) = Ku(a, z), 
0 « z « L, and u(r,0) = uo, u;(r, D) 20,0 € r « a. 


54. Solve?! the partial differential equation 


Ou lôu Pu 2 
ðr? rör ðZ ^U 


: 0<r<1, 0<z<1, 


39 See Stripp, K. F., and A. R. Moore, 1955: The effects of junction shape and surface recombination on 
transistor current gain — Part II. Proc. IRE, 43, 856-866. 


40 See Bischoff, K. B., 1966: Transverse diffusion in catalyst pores. Indust. Engng. Chem. Fund., 5, 
135-136. 


41 See Gunn, D. J., 1967: Diffusion and chemical reaction in catalysis and absorption. Chem. Engng. 
Sci., 22, 1439-1455; Ho, T. C., and G. C. Hsiao, 1977: Estimation of the effectiveness factor for a cylindrical 
catalyst support: A singular perturbation approach. Chem. Engng. Sci., 32, 63-66. 
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subject to the boundary conditions that lim, ,o |u(r, z)| < oo, u(1,z) = 1, 0 <z < 1, and 
u(r,0) = u(r,1) = 1,0 < r < 1. Hint: Break the problem into three parts: u(r,z) = 
u(r, z) + us(r, z) + us(r, z), where 

0?u, 1 Ou, 8u 2 


Ir? a + 92 a'ui, 0<r<1, 0«zc«l, 


subject to the boundary conditions that lim,_,9 [u1 (r, z)| < oo, uı(1,z)=1,0 < z < 1, and 
ua (r, 0) = u(r, 1) =0,0<r<1,; 


O07 ue 1 Qu» 07 us 2 
r2 Lr | = auz, 0<r<1, 0<z<1, 
subject to the boundary conditions that lim, 5o |ua(r, z)| < oo, u2(1,z)=0,0 < z < 1, and 


ua(r,0) = 1, u3(r, 1) 20, 0 <r < 1; and 


0?ua 1 Qua 0?ua 2 
| = ] 0xr«l1, 0«z«1, 
Or? r Or Oz? [5 id " 


subject to the boundary conditions that lim,_,9 |ua(r, z)| < oo, u3(1, 2) = 0,0 < z < 1, and 
u3(r,0) 20, us(r, 1) 2 1,0 € r « I. 


55. Solve?? Laplace's equation in cylindrical coordinates 


0?u 1 ðu i Pu 
Or? rOr | 0z2 


0, O0<r<a, —oo«c«z«oo, 


subject to the boundary conditions that lim, ,o |u(r, z)| < oo, 


pen. —V, |z| < d/2, 
WR) ={ 0, — |e) >d/2, 


and lim),|.. u(r, z) + 0, 0 € r « a. Hint: Show that the solution can be written 


a 


ot k 
u(r,z) 2 -V + Y ds cosh ( 27) ^( =") : |z| < d/2, 
a 


n=1 


3 kn kn 
u(r.2) =X Brexr( Ea =") ; |z| > d/2 
n=1 


with the additional conditions that u(r, d~ /2) = u(r,d*/2) and u;(r, d7 /2) = uz(r,d* /2), 
0 € r « a, where kn is the nth root of Jo(k) = 0. Then find A, and Bn. 


56. Solve Laplace's equation in cylindrical coordinates 


Ou l 1 ðu l u — 
Or2 rOr Oz 


0, O0<r<b 0<z<œ, 


42 See Striffler, C. D., C. A. Kapetanakos, and R. C. Davidson, 1975: Equilibrium properties of a rotating 
nonneutral E layer in a coupled magnetic field. Phys. Fluids, 18, 1374-1382. 
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subject to the boundary conditions that lim, ,o |u(r, z)| < oo, u,(b, z) = 0, 0 < z < œ, and 
lim; 55s |u(r, z)| < oo, 

A, O<r<a, 

0, a<r<ob. 


u(r, 0) = { 


57. Solve? 
Oru F lôu | u ðu 
Or? rðr ` Oz) Oz 
with the boundary conditions lim,_,9 |u(r, z)| < oo, ur(1,z) = —Bu(1,z), 0 < z, and 
u(r,0) = 1, lim; 555 |u(r, z) < oo, 0 € r < 1, where B is a constant. 


=0, 0<r<1, 0«z«oo, 


58. Solve** K E. 5 
u lôu u 1 ðu 
| | =0 < b 
ðr? rr Oz  HOz y OST Ue 
with the boundary conditions lim,_,o |u(r, z)| < oo, ur(b, z) = —hu(b, z), 0 < z, along with 


lim; 55s |u(r, z)| < oo, 0 € r < b, and 


u(r, 0) i Q, O<r<a, 
H = usin = [8 a X r « b, 


where b > a. 
Separation of Variables Solution for Poissons Equation 


59. Let us solve the axisymmetric Poisson equation inside a circular cylinder 


18 f Qu Pu 
2104) ag 7 9 O<r<a, |z| «6, 


subject to the boundary conditions lim,_,9 |u(r, z)| < oo, u(a, z) = 0, |z| < b, and u(r, —b) = 
u(r,b) 20,0 r « a. 


Step 1: Replace the original problem with 


18 / Ou 0?u 
xx) +o —Au, O<r<a, |z| «5, 


subject to the same boundary conditions. Use separation of variables to show that the 
solution to this new problem is 


Unm(T, Z) = Anm Jo (&.7) cos 


where kn is the nth zero of Jo(k) = 0, n = 1,2,3,..., and m —0,1,2,.... 


43 See Kern, J., and J. O. Hansen, 1976: Transient heat conduction in cylindrical systems with an axially 
moving boundary. Int. J. Heat Mass Transfer, 19, 107—714. 


44 See Smirnova, E. V., and I. A. Krinberg, 1970: Spatial distribution of the atoms of an impurity element 
in an arc discharge. I. J. Appl. Spectroscopy, 13, 859-864. 
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Step 2: Show that f(r,z) can be expressed as 


j-YY anmJo( nz) cos 


(m1) sl 


where 


1 
Qnm = PED -f, n f(r 2) Jo(k E) E Em r dr dz. 


Step 3: Show that the general solution is 


» ee (k,r/a) co s[(m + 3) 7z/b] 
NO e a 
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567 


In several of the problems and examples, it is convenient to express the Laplacian: 


Pu du 
| ðr? Oy? 


in terms of polar coordinates x = r cos(0) and y = r sin(@). 
We begin by computing 


From the chain rule, we have that 


ðu  OuOÓx  OuOy | 
ðr  OÓrÓr yðr — 


and 


ios] ð (Ou od x 
zu Ox\ Ox) Or Oy 


+n) [s (5) or * al 
) 


On the other hand, 


ðu  OuOx  OuOy - 
00 0x00 OyO0 


(12.A.1) 


(12.4.2) 


(12.4.3) 


(12.A.4) 


(12.A.5) 


(12.4.6) 


(12.4.7) 
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and 
3u Ou ð (Ou Ou 9 (Ou 
398 ^77 cos(8) 5 — r sin(0 dag (5*) -=r mu Tr cos(8) 35 (=) (12.A.8) 
u , 9 (0uY Oy 
= —r cos(0 o5; ree [s (5 “\ a (=) A 
: o O (OuN Oy 
— r sin(0) — 12.A. 
r sin( P E cos(0 IAE ih a. 4 ( 9) 
8u 
= —r cos(0) ioni —r sin(0 aa +r cos(0 Janay | 
-r sin(0) $t +r cos(0) < [-r sin(0)]=—— +r wa (12.A.10) 
oy ap A. 
=-r costo) x + sin(0) — 3; 
: Oru o?u Oru 
+r? E (0 aa — 2sin(0) een + o 0)7.. (12.A.11) 
Dividing both sides of Equation 12.A.11 by r?, we find that 
1 8u TONE  . Guns Ont . Oru 2, 0U 
S39 77.5, 8m (0) 53 — 2sin(0) orem + cos Oa (12.A.12) 
Because sin?(0) + cos?(0) = 1, we obtain the final result that 
2 2 2 2 
Oru 0^8 SO, depu OM. (12.A.13) 


Ox? p Oy? Or? rðr 


Appendix B: Derivation of the Laplacian in Spherical Polar Coordinates 


In problems involving spherical geometries, it is convenient to re-express the three- 
dimensional Laplacian: 
Oru l u u 
ðr? | Oy? Oz? 


in terms of spherical polar coordinates x = r cos(g)sin(0), y = r sin(y) sin(@), and z = 


Vĉ?u = 


(12.B.1) 


r cos(0). 
Because 
x = cos(y) sin(0), Oy = sin(y) sin(0), 97 = cos(0), (12.B.2) 
Ór Ór Ór 
an =r cos(q) cos(0), x =r sin(y) cos(0), 2 = —r sin(0), (12.B.3) 
en ð ð ə 
CANC : Oy _ Oz — 
sU r sin(y) sin(0), do r cos(q) sin(0), De 0, (12.B.4) 


we have that 


ð  Ox0  OyO ,0z0 
De. Gr o os Or Oz 


= cos(q) sin(£) Č + sin(y) sin(8) Z + cos(0) Z, (12.B.5) 
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ð rð ,OyO zð | i 253520. : ep E o 
86 ^ D0 da + 06 y + 3682 T" cos(q) cos(0) zz +r sin(y) Reni -=r sin(6) zz 
(12.B.6) 
and 
ð xð Oy ð Oz ð 


Op OpOr OpO0y OpOz 


— —r sin(y) sin(£) 2- +r cos(y) sno) Z. (12.B.7) 


Solving for 0/O0x, 0/Oy, and 0/0z, we have that 


ð i cos(y) cos(0) à sin(y) à 


o 
— i 0 . . 
Ox cost sink 5r r 00 or sin(@) Oy’ DABIS) 
ð p ð , sin(g)cos(0) ð cos(y) O 
a sin(y) sin(@) 5:7 - 88 * 7 sin(8) Og’ (12.B.9) 
dcs a 8 sin(@) d 
sin 
z cos(0) z se (12.B.10) 
Next, let us introduce the unit vectors in r, 0 and q directions: 
T = sin(0) cos(q)X + sin(0) sin(q)y + cos(0)z, (12.B.11) 
6 = cos(0) cos(y)® + cos(0) sin(y)¥ — sin(8)2, (12.B.12) 
Q = —sin(g)X + cos(g)y (12.B.13) 
Or " 
X = sin(0) cos(y)r + cos(0) cos(i)0 — sin(y)§, (12.B.14) 
y = sin(0) sin(y)F + cos(4) sin(p)f — sin()Q, (12.B.15) 
Z = cos 0)f — sin(0)0. (12.B.16) 
Because 3 ə ə 
V= ur RET (12.B.17) 
we find that ə i v3 
V —$— 4. G (12.B.18) 


arr OO Prsin(0) Op 


Because the unit vectors T, 0 and @ are not constant we will need the additional terms: 


3,795 3-795 3-0 3-9 sa--9 5-9 (12.B.19) 
s = — sin(0)Q, M = cos(0)Q, = = — sin(8)f — cos(0)8. (12.B.20) 


Using Equation 12.B.18 through Equation 12.B.20 we now compute V - V. The final result 
is 
u u Ow. 0r). 1 o 
Ox? Oy 


= 1 O7u 


0:2 r Or? ' r?2sin(0) 00 E 90 T r? sin(0) Oy?’ HEB 
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Further Readings 


Hobson, E. W., 1965: The Theory of Spherical and Ellipsoidal Harmonics. Chelsea Pub- 
lishers, 500 pp. The classic treatise on Legendre polynomials. 


Lebedev, N. N., 1972: Special Functions and Their Applications. Dover, 308 pp. A very 
practical guide to the special functions found in the natural sciences and engineering. 


Watson, G. N., 1966: A Treatise on the Theory of Bessel Functions. Cambridge University 
Press, 804 pp. The standard reference on Bessel functions. 


Answers 


to the Odd-Numbered Problems 


Section 1.1 


1. first-order, linear 
7. third-order, nonlinear 


13. first-order, nonlinear 


Section 1.2 

1. y(z) = —In(C — z? /2) 
7. y(x) = —In(C — e”) 

19. [X] 2 o [1 — e- &**»t] 


Section 1.3 

1. lnn|jy| - z/y = C 

T. sin(y/z) ^ ln |z| 2 C 
Section 1.4 


1. zy? — ir? =C 
T. cos(xy) = C 


3. first-order, nonlinear 
9. second-order, nonlinear 


15. second-order, nonlinear 


3. y? (x) — In? (x) = 2C 
9. sin?(y) = 21n(z) + C 


5. second-order, linear 


11. first-order, nonlinear 


5. 2+ y?(x) = C(1+ 2?) 
11. y(x) = x + Ce-V* 


9. 4% arctan (2452) — In|z| + C. 


vV3z 


3. zy? — z + cos(y) = C 
9. ^y? +a°>yty=C 


13. y — z + isin(2z + 2y) = C 
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5. y/x +ln(y)= C 
11. zyln(y) + e” —e "—C 
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Section 1.5 


1. y(z) = ie*--Ce *, z € (—00, 00) 3. y(x) 2In(z)/ zx Cr !|, «40 
5. y(x) = 22? In(z) + Cr’, x € (—00, 00) 
7. &eX)y(r)=C, nro < 2x € (n-- 1) +y, where ¢ is any real and n is any integer. 


9. y(x) = 4 + Her, x € (—00, ov) 11. y(x) = (x + C) esc(x) 


_ cos*(x)y(0) , c cos? (x) * [sec(£) + tan(£)]^ 
PE) = E UE fedt) Fea Ge n cosrHi(g) e 
6 Bag o.. ertum asin(2wa) — wcos(2wx) 
15. yla) = 8a?  ' 8a? (a? +w?) 8w(a? + w?) 


17. y? (x) = 2(z— z?/*)/(2— k) if kz2; y?(z)=xln(1/r) if k=2 


19. [AJ = (Ale (Bio = ea poe e 
e kat — 9e ^it 
ico = [Alp (14 =) 
21. y(x) = [Cz + zIn(z)] ! 23. y(z) = [Cr NT 1g? In(z)]" 


25. y(x) = [Cx — zln(z)]!? 


Section 1.6 


5. The equilibrium points are z = 0, i, 


the equilibriums at x — 0 and 1 are stable. 


and 1. The equilibrium at xz = i is unstable while 


7. The equilibrium point for this differential equation is x = 0, which is stable. 
Section 1.7 

1. c(t) 2 et - t1 3. x(t) = [1 — In(t + 1)! 

Section 2.0 


1. yo(z) = A/a 3. yo(x) = Axt 5. yo(x) = A(z? — x +1) 
T. yo(x) = Asin(z)/ x 9. y(z) = Cze” 11. y(x) = (1 + Coe”) /Cy 


13. y(x) = —In|1-2| 15. y(x) = C1 — 21n(z? + C3) 
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Section 2.1 


1. y(x) = C1e * + Coe 9? 3. y(x) = Cle” + Coxe” 
5. y(x) = Cie?" cos(2x) + Coe?" sin(2z) 7. y(x) = C1e t? + Ozet” 
9. y(x) = e74" [C1 cos(3x) + C» sin(3x)] 11. y(x) = C1e7** + Core™’? 
13. y(x) = C1 + Cox + C3 cos(2x) + C4 sin(2x) 
15. y(z) = T + Cae? cos( V3 x) + Cse-? sin( v3 x) 
17. y(x) = Cy + (Co + C3x + Cax?)e* 
( 


19. y(t) = e-/ 9? { Aexp[tV1 — 2A7/(27)] + Bexp[—tV1 — 247/(27)]] 


Section 2.2 


1. a(t) = 2/26 sin(5t + 1.7682) 3. z(t) = 2cos(rt — 1/3) 


5. x(t) = so cos(wt) + A sin(wt) and v(t) = vo cos(wt) — wso sin(wt), where w? = Mg/(mL). 
w 
Section 2.3 


1. a(t) = 4e7% — 2e7*t 3. a(t) = e-9'/? [4 cos(6t) + 32 sin(6t)] 


5. The roots are equal when c = 4. 


Section 2.4 

1. y(x) = Ae ?* + Be * + ix - d 3. y(z) = e” [A cos(x) + Bsin(z)] + z2 - z 4-2 
5. y(a) = A+ Be ?* + ir? 2x ie 77 7.y(x) = (A+ Bz)e?* + (12 — &) e* 

9. y(x) = Acos(3x) + Bsin(3x) + 42? sin(3x) + $z cos(3x) 


2ax —1 gg v asin(2wa) — wcos(2wx) 
8a? 8a? (a? + w?) 8w(a? + w?) 


11. y(x) = 


Section 2.5 


2 B 
wiw Eo  . o) E sin(wt) 
iya RG) ae Ludum Esci dasa 
y = 3, 5. I(t) Tw? — 1/0 sin(wit) hae 
Section 2.6 
1. y(x) = Ae” + Be?” + 1e7? 3. y(z) = Ae?* + Be ?* — (3x + 2)e*/9 


5. y(zx) = (A+ Baje~?* + 23-2" /6 7. y(x) = Ae?* + Bre” + (52? + $a?) e? 


9. y(x) = Ae” + Bxe* + xln(x)e* 11. y(x) = Ae” + Be?” + 1 cos(x + 3) — 2 sin(x + 3) 


Section 2.7 

1. y(x) = Ciz + Cox7! 3. y(x) = Ciz? + Co/x 

5. y(x) = Ci/z + C2 ln(x)/x 7. y(x) = Ciz cos[2 In(x)] + Cox sin[In(z)] 
9. y(x) = Cı cos[In(z)] + C» sin[In(z)] 11. y(z) = Cyr? + Cort + C3/x 
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Section 2.8 


1. The trajectories spiral outward from (0,0). 
3. The equilibrium points are (2,0); they are unstable. 


5. The equilibrium points are v = 0 and |z| < 2; they are unstable. 


Section 3.1 


Piaf es Tp [95 5 3 (65 100 
9. BB - JE LIE Jj 11. A e - (3 A 


11 8 
13. yes o a 15. ys | 8 4 17. no 
2 5 
5 3 
at 1 1 
19.44+3A=|] 7 14| =7A 21. (AT) =|1 mA 
21 7 3 1 
22 2 
23 anc- (1 r) - Go) 25. (4+B)c= ( )=40+8C 
010 010 100 9. 1 X fay 2 
27. 3 di i0 Oel r0 29. |4 2 5] [a]=(6 
0 0 1 0 0 1 0 0 1 6 -3 5/ \ z3 2 


Section 3.2 


T. 3.1 5. —24 7.3 


Answers to the Odd-Numbered Problems 


Section 3.3 

1. tı = 2, T2 = 3 

5 X1 0, X2 0, T3 —2 

Section 3.4 

1. t= 1, £2 L2 

5.21— — l, £2 = 2a, £3 =a 
1. _ /—1/13 5/13 

Medi ={ 2/13 3/13 

Section 3.5 
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3. X1 = —4, £2 = —5 


T. Ly = —3, z2 = —4/5, X3 = 3/5 


3. £1 = 23 = 0,29 = —a 


7. di = 1,22 = 2.6, 3 23 


1 2 5 
11.4 1-|0 -1 2 
2 4 1 


2 1 
1. A=4, x=a(7): a x0 =8 (Jy) 


- 3 —3 
3. A—14- V6, x -a( A): A=1- V6, x - 5( 7) 
ES 3 1 
5.A=1, xo=zaļ| 0 ]4+6 {1 A=0, x=y7I{ 1 
1 0 1 
1 0 1 
T. A21, xp=alO0}]+6] 1 A-2, xo9—^*|1 
0 —1 0 
1 3 T 
9.A—0, xo—o|1 A=1, xo—-8|2 A=2, xo—vy|3 
1 1 
0 2 0 
114-20, xp=a}] l A=2, xp9=6{ 1 A=3, xo9—vy|2 
0 0 3 
13. 
23 .— 23p-1_{1 1 -1 0 0.5 —0.5 
MI cae z 1 0 528 0.5 0.5 
(0.5523 —0.5 0.5 573 +0.5 
~ 10.557 +40.5 05573 —05/' 
Section 3.6 
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|. f —3cos(2t) — 2sin(2t) V ; 2cos(2t) — 3sin(2t) V , 
9. x= C3 ( Á cos(2t) ) PE ( ui Im ) 5 


E 2 cos(t) = 2 sin(t) —8t 
TUIS E um diis: (vasto = — di 


Dc D cos(2t) + id diae: (^ cos(2t) — xs J 


cos(2t) sin(2t) 

i4 E 0 0 
15. x-a( Jetta le 17.x=c,{1]+e.[ 2] e+c3 | 1 |e” 

2 2 

0 1 0 

3 1 0 
19. x= c | -2)e*+o{/0]e+ c3 | 1 e% 

12 2 0 


Section 3.7 


9 
e ange —3ett + J , k e . d 3t?! Ate? + $0 


1. Ł e?t 3te?! 
2 ett Es e?t — e&t mE 3e?t 0 e 0 0 ET 
iffe , 
z(t) = [e' cos(2t) + e sin(2t)] zı (0) — e sin(2t)a(0) + 5 sin(2t) 
t 
x(t) = 2e sin(2t)x1(0) + [e' cos(2t) — e' sin(2t)] x2(0) + E [1 + sin(2t) — cos(2t)] 
9. 
xı (t) = e" cos(2t)z(0) + Fe” sin(2t)x2(0) 
xo(t) = —2e”* sin(2t)z, (0) + e” cos(2t)z3(0) — te?! 
11. 
x1(t) = [cos(t) + 2sin(t)]z1(0) — sin(t)x2(0) + t cos(t) + tsin(t) 

zg (t) = 5sin(t)z1(0) + [cos(t) — 2sin(t)]z2(0) + t cos(t) + 3tsin(t) — sin(t) 

13. 
xilt) = e'z3 (0) + [e** — e*] x2(0) + [e* — e?*] x3(0) + $e” + łe% -e t 1 
v(t) = e**xo(0) + [e* — €?*] 5 (0) + ge + Se — 8, 
13(t) = e?'z3(0) + $e! —t— $ 

15. 


ni) = (E+ 4e) 0) + (BE Re ss(0) 4 + ge Be 
r9(t) = e'x9(0) + te' 


x3(t) = (3e? = ie!) z4(0) + (ie? + 2e™) x3(0) 2e% se se 
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Section 4.1 


1. ax b= —3i + 19j+10k 3.axb=i-—8j+7k 5. a x b = —3i — 2j — 5k 
9. Vf =y? /2 i+ 2ry/z? j - 3ay? /z* k 

11. Vf = 2x/ (a? +y? + 22) i+ 2y/(z? +y? + z2j --2z/(x? + y? + 27)k 

13. Vf = 2i — 2yj + 2zk 

15. Plane parallel to the xy-plane at height of z = 3. n = k 


17. Paraboloid, n = —2x i/ v1 + 4z — 2yj//1 + 4z *- k/ 1 + Az 

19. A plane, n = j/ V2 — k/ 2 

21. A parabola of infinite extent along the y-axis, n = —2r i/V1 + 42? + k/V1 + 422. 
23. c¢=y-—landy=z 25. x = 2y/(Ty — 6) and z = 3y/(4y — 3) 
27. y= —In(3 = ia?) and z = 6 — ic? 


Section 4.2 


1. V.F 22zz- 2, VxF-(2zy -2yz)i + (z? -?)j, V(V-F) = 2zi + (22 + 2z)k 


3. V.F =2(x — y) — xe ?" + re, V xF —2zze?!i— ze?!j-4[2(x — y) — ye ""]k 
V(V-F) = (2— e-** + zye-*" 4- e?) i+ (z2e7* + 2xe?? — 2) j 


5. V-F=0, Vx F=-—27i+ (5y— 9r?)j + (2zz—5z)k, V(V-F)=0 


7. V-F =e +22? — 3e, Vx F=—2yzit zek, V(V - F) = —e7¥j + (22 + 3e77)k 


9. V. E = yz + a?ze^ + rye’, 
V x F = (ze? — x3 ye* — a?yze^)i + (xy — ye*)j + (32?yze? — xz)k, 
V(V -F) = (32?ze? + ye?)i + (z + e?)j + (y + 326? + x ze* + zye?)k 
11. V. F =y? +22? — zysin(z), 


V x F = [xcos(z) — 2zyz|i — y cos(z)j + (yz? — 2xy)k, 
V(V-F) = [2? — ysin(z)]i+ [2y — zsin(z)]j  [2zz — zy cos(z)]k 


13. V -F = y? + zz — zysin(z), 
V x F = [rcos(z) — xyli — y cos(z)j + (yz — 2zy)k, 
V(V-F) = [z — ysin(z)]i + [2y — zsin(z)]j + [x — zycos(z)]k 


Section 4.3 

1.16/742/(3») 3. e? + 2e8/3 + 94/2 13/6 5.4 7.0 9. 2r 
Section 4.4 

1. (x,y,z) = a?y + y?z + Az + constant 3. (x,y,z) = xyz + constant 

5. p(x, y, Z) = x? + 5x + y? --In(z)-F constant 7. (x,y,z) = xe? + y? + constant 

9. p(z, Y, Z) = zy + xz + constant 
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Section 4.5 


1. 1/2 3.0 5. 27/2 T. 5 
9. 0 11. 40/3 13. 86/3 15. 967 


Section 4.6 

1. —5 3.1 5.0 7.0 9. —16r 11. —2 
Section 4.7 

1. —10 3. 2 5. 1 7. 45/2 
Section 4.8 

1.3 3. —16 5. 4m 7. 5/12 


Section 5.1 


1. f(t) = : - M sin[(2m — 1)t] 


2m — 1 
m=1 
mown (1-1 Ti. s 
3. f(t) = I + 2. —- cos(nt) + -— "€ sin(nt), 
Tt 2 c^. 2cos(nr/2) sin? (nm /4) sin(nm/2) . 
5. f(t) = 3 e 5 n2 cos(nt) + Sa sin(nt) 


n=1 


sinh(aL) : = (—1)” nrt 
7. f(t) = =y + 2aLsinh(aL) > a qu C5 


: n(—1)^ . (nit 
—2r sinh(aL) x IP. nea sin( L ) 
n=1 


2^ cos(2mt) 


9. f(t) = - + ; sin(t) 7 5 


— 4m? -1 
11. f) = 5 E » Sn 7 cos| OM nt) 25» EE sin( 2) 
13. f(t) =" 7 iu - 2 an icd h 2 enD] 
Section 5.3 
3. f(x) = 2 E Y 4 (27), fle) = a x — s [Ene 
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m—1)ra Le 
5. f(z) = 1-2 à Y £ : M" xU D Ome z sin[(2m — 1)nz] 
m=1 
APOE = ay - pasa -— x sin(nz) | à Ly. TRO 
n=1 m= 
a Gc ™ sin — 1)7/6 2m — l)re 
o f) t+ E B n "n " | 
m=1 
a ee (-1)"sin(mm/3) . (2mm 2a A (—1)? NTL 
1-5 C3 ma cara ec rere 
m=1 n= 
11. fle 342 medi pee 
TE as ean 2(—1)" aee 
n=1 
iic M : oo esa) —1 cos( 272) . 
1—1 
f(x) = DE aO - sin( 272) 
n=1 
Section 5.4 
1. ft) = > wo sin2nzt), — f(t) = 23 wo cos(2nzt — 7/2) 
n=1 n=1 
3. f= 5 > os [O03 [i-r igh, 
1 
f= 3-2 he sin [ERU caps 
n=1 
T = n — T T A4«ssin((2n — 1)t — 1/2 
5. fQ= 5+ i y TC 1 f= SE [K — P 
nci n=1 
7. Defining 


= 2 fresi? (^7) + [2 cos (MY), 
f(t) =16 + 5 4. cos( 27! + on) > Pn = tan” E [1 x cos(25)] / sn (7) ]- 


n=1 


and ọn lies in the first and second quadrants; and 


aie aA es). ventu [nm] [C]. 


n=l 


and ọn lies in the second quadrant near 7. 
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Section 5.5 


T 2 o ci (2m 1)t i entit 
FO 2 m e (2m — 1)? 9-419 * T p n 
nz 
ME E een 3i x exp(nnti/3) 
5. f(t) = 2—— ————— 7. f(t) = —2 
nz 
Section 5.6 


2 en (2n — 1)t] 
qme (2n — 1) + (2n — 1)3 


1. y(t) = Acosh(t) + B sinh(t) 


1 6 cos|( 2n — 1t ] 
. y(t) = Ae” + Be += + 
3. y(t) € CE" z> p 1P + 9(2n — 1)? 
2 ye (2n — 1)?] sin[(2n — 1)t] 
“ee | 2n — a [2 — (2n — 1]? + 9(2n — 1)?} 
oo CA ! m 2 oo gin )t 
5. = Vna T. To m 
9 q(t) = Y wn einwot 
l „í (inwo)? + ianwo + w? 


Section 5.7 

1. f(t) = $ — cos(mx /2) — sin(nz/2) — 4 cos(nx) 

Section 6.3 

1. me™le/al/ja] 3. F(w) = 4e-9'" sin(w)/w 

Section 6.4 

1. f(t) = —t/(1+4?)? 3. f(t) = e-ltl/2 5. f(t) = e"! H(t)-e-'? H(t) + ste/? H(t) 


Section 6.6 


Section 6.7 


1 1- 
1. u(x, y) = = ru x 
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Ti 1- 1+ T, -T —1) +y? 
i ia) = n ( y) tt alk ET tym | e 


Section 6.8 


b—a b+2 
1. u(x,t) = 5 at( 5) + 5 ot( or) 


b-2 d 
3. u(z, t) = 510 erf( ==) + iTo arf( 2] 


Section 7.1 


1. F(s) = s/(s) —a?) 3. F(s) 2 1/s-- 2/5? - 2/8 5. F(s) = [1 — e?6-] /(s — 1) 
7. F(s) = 2/(s? +1) — s/(s? + 4) + cos(3)/s — 1/8? 

9. f(t) = e7 11. f(t) = $sin(3t) 

13. f(t) = 2sin(t) — 3291? + 2e™* — 6cos(2t) 17. F(s) = 1/(2s) — sT?/[2(s?T? + 7”)] 
Section 7.2 

1. f(t) = (t-2)H(t—2) - (t-2)H(t —3) 3. y" -- 3y' + 2y = A(t — 1) 


5. y" -- Ay! + 4y = tH(t - 2) 7. y" — 8y! + 2y =e" H(t — 2) 
9. y" + y = sin(t)[1 — H(t — x)] 


Section 7.3 

1. F(s) = 2/(s? + 2s 4- 5) 3. F(s) 22e ?/s? + 2e 5/s? + e^ 5] 
5. F(s) = 1/(s — 1)? + 3/(s? — 2s + 10) + (s — 2)/(s? — 4s + 29) 

7. F(s) = 2/(s + 1)? + 2/(s? — 2s + 5) + (s 4-3)/(s? + 6s + 18) 

9. F(s) 22e 5/s? -2e 5/s? + 3e 5/s + e ?5/s 

11. F(s) = 4(s + 3)/(s? + 6s + 13)? 13. F(s) = 1/(s? +1) + e^" /(s? +1) 
15. f(t) ee 17. f(t) = e7* cos(t) — e™ sin(t) 

19. f(t) = te * — 1e * + cos(t)e * 

21. f(t) = te ?* — te% + cos(t)e ?* + 2sin(t)e ?' 


23. f(t) = (t - 2)e-*- H (t — 2) 25. f(t) = e-?-9 sin(t — 4)H (t — 4) 
27. f(t) = 4 sin[2(t — 1) H(t — 1) + [((— 3)?/2 — (t — 33/6] H(t — 3) 
29. F(s) —e76-9/(s—10 -Ee76-U /(s — 1) — e71) /(s — 1)? = 2e72(670 / (s — T) 


31. f(t) = 1t — 1H (t — 2) = it — (t -2)H (t — 2)/2 — H(t — 2) 
F(s) = 1/(252) — e?s/(25?) — e-?5 /2 

33. f(t) 2 t — 2(t - 2)H (t — 2) + (t — 4)H(t — 4) 
F(s) = 1/8? — 2e?5/s? + e748 /s? 
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35. Y (s) = e^?/[s(s + 1)(s + 2)] 

37. Y (s) = 2/(s + 2)? + e ?5/(s?(s + 2)?] + 2e ?5/[s(s + 2)?] 

39. Y (s) = 2(s — 3)/[(s — 1)(s — 2)] + e ?5?/((s + 1)(s — 1)(s — 2)] 
41. Y (s) = 1/(s? +1)? + e75" /(s? + 1)? 

43. F(s) 1/57, Bit, oer (se) Slim, 1/s = 0 = f(0) 

45. F(s) =1/(s +1), lim, ,s, sF(s) = lim, ,55 s/(s +1)? = 0 = f(0) 


48. Yes, lim, ,o sF(s) = 1 
49. Yes, lims_,9 sF(s) = 0 = f(oc) 
51. Yes, lim, ,o0 sF(s) = 1 


Section 7.4 


1. F(s) =coth(sx/2) A (s? 4-1) 3. F(s) = Ua Rp 
Section 7.5 

1. f(t) = e™ — e7% 3. f(t) = Set i ge t = ze” 
5. f(t) = e^?! cos(t + 32) 7. f(t) = 2.3584 cos(4t + 0.5586) 


9. F(t) = 1 + X2 cos(2t + 52) 


Section 7.6 
11. f(t) 2 et —t-1 


Section 7.7 


1. y(t) = $e? — 1 $t 3. y(t) = e” — e?” 5. y(t) = - $e + Tet + Stet 
7. y(t) = $e * + feb — ie? — 9.9(t)  (t- 1 H(t - 1) 
11. y(t) = e% — e + [} + 192070 — et-1] H(t — 1) 
13. y(t) = [1 e 27?» — 2(t — 2)e-?*-2] H(t — 2) 
15. y(t) = et 2) ze 2 ze e 2 H(t — 2) 
17. y(t) = 1 — cos(t) — [1 — cos(t — T) H(t — T) 
19. y(t) = e*t — 1e? — 3 + 14 — [ec (79 — Fe A) — 2 + 1(t— a)] H(t — a) 
+a [1e7379 + (t — a)e- 6-9 — 1] H(t — a) 
21. y(t) = te’ + 3(t — 2)e*? H (t — 2) 
23. y(t) = 3 [e 9*7» — e-30-2] H(t — 2) + 4 [e-3479 — e720-9] A(t — 5) 


25. x(t) = cos(V/2t) e% — sin(V2t) e / V2, y(t) = sin(V2t) jet / v2 
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27. x(t) =t— 1 +e™cos(t), y(t) 2 ? — t+ e *sin(t) 


29. x(t) = 3F, — 2F» — Fi cosh(t) + Foe’ — 2F, cos(t) + Fz cos(t) — F> sin(t) 
y(t) = Fo — 2F, + Fyre — F; cos(t) + Fi cos(t) + F; sin(t) 


Section 8.3 


af; 1 , [Emme m [emn 


OU 
e 
S 
= 
Ww 
l 
e 
=) 


eee) 


| 5 Sr sl (2n i sinl (2n = ud sd (2n — 9e] 


4L & (-1)"*1 , [(2n— 1)zx (2n — 1)rct 
7. u(x,t) = m? 24 (n - 1j sin T cos 7 
Section 8.4 


1. u(x,t) = sin(2x) cos(2ct) + cos(x) sin(ct)/c 


lta? cU e? sinh(ct) 
3. u(x,t) = j 
(1 + z2 + c?t?)2 + Ag2c242 z 
5. u(x,t) = cos( 7) cos Tct : sinh(az) sinh(act) 
2 2 ac 
Section 9.3 
_ 4A °° sin|(2m — 1)x] S s 
1. mo 
Bá ux 2m —1 
3. u su sin( (nz)e-* ^t 
n=1 
baer (ater nere 
E 2m — Tyre *" m-t 
5. u(x,t) T (2m — 1? sin[(2m — 1)z]e 


T 4 > cos|(2m — 1)z] —a? (2m —1)?t 
T. u(x,t) = PD 2m1)? en ( ) 


nm 4 cos[(2n — 1)z pE a? (2n—1)*t 
9. u(z,t) — Ll». (n — T? 


4(T, — To) in[(2m — 1) 
11. u(x,t) = To + ——— 2 x ol CE 
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B l (ha — hije | 2(h; —h)) &« (-1)*. , (max an? 1? 
13. u(x,t) =hi4 L + - 2 s sin( L ) exp T2 t 
1 2 x3 (-1)* NOCET 
15. u(x,t) = 3 t r2. cos(n7x)e 
AX (-ImH EU. 
17. u(x,t) = - 5 (an — 14 sin[(2n — 1)] [1 - nox | 
n=1 


= n , (mna n?n? 
19. u(x,t) = 2n X Powe sin( D ) fo] ( D | 1) ] i} 
n=1 


_4 2 sinh[(2m — 1)z(a — x)/b] sin[(2m — 1)ry/b] 
m a (2m — 1) sinh[(2m — 1)ra/b] 

|... 2a e^ sinh(ny/a) sin(nzz /a) 
Sete A ee n sinh(nzb/a) 
5. u(z,y) 21 T. u(z,y) =1 


9. u(zx,y) = ui + Bo(y — 6)/2 + >D B, sinh[nz(y — b)/a] cos(nrx/a), where 


n=1 


Bo = 2u; /b — af f(x) dx/(ab) and Bn = a f(x) cos(nzx/a) dx/|a sinh(nzb/a)] 


11. u(x, y) = Ao + 5 An cosh(nzy/ L) cos(nzx/ L), 


n=1 
where Ag = 2g [Lzo + 3cL? + a/b — acos(bL)/b] /L 
and cosh(n729/ L) A, = 2gcL[(—1)" — 1]/(n?z?) — 2abgL[(—1)" cos(bL) — 1]/(b?L? — n?r?) 
13. u(r, p) = To 


Section 10.4 


64 R OS (21) (-1)mti 
(2n — 1)(2m — 1) 
cos[(2n — 1)ra/2a] cos[(2m — 1)ry/b] 
(2n — 1)(2m — 1)[(2n — 1)?/a? + (2m — 1)? /b?] 


n=1m=1 


x 


Section 11.1 
1. An = (2n — 1)?n?/(4L7), yn(x) = cos[(2n — 1)mz/(2L)] 
3. Ao = —1, yo(x) = e^* and Ay = n°, Yn(x) = sin(nz) — n cos(nx) 


5. An = —n*a^/L^, yn(x) = sin(nzz/L) 
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T. M, = K2, y. (x) = sin(k,z) with kn = —tan(k,) 


9. Ag = —m$, yo(x) = sinh(mox) — mo cosh(mox) with coth(mom) = mo; An = k? 
yn(x) = sin(k,z) — kn cos(knx) with kn = — cot (knr) 


11. 

(a) An cun? Yn(x) = sin[nz ln(z)] 

(b) An = (2n — 1)?z? /4 Yn(x) = sin[(2n — 1)x1n(z)/2] 
(c) ào=0 yo(x) =1 An = nn? Yn(x) = cos[nz In(z)] 


13. A, 2 n? +1, y, (x) = sin[nIn(z)]/z 


15. A = 0, yo(x) = 1; ya(z) = cosh(Anx) + cos(A42) — tanh(A,,)[sinh(Anz) + sin(Asz)], 
where n = 1,2,3,..., and A, is the nth root of tanh(A) = — tan(A). 


Section 11.3 


1. f(z) = Z Y ae sin(777) 3. f(x) = E » LL sin| E m c 


O 8L qux (71) . [(2n - ra =e 
T. u(x,t) = PI 2. (n — 13 sin 7 cos |: Anc? —h | 


+hsin iV? — — — m). where An = (2n — 1)?z?/(4L?) 


æ (1 (n= s] osi 

9. SY 2n — s os| 2 i 

"" 3m pen » gn [St ; 2] e72 (2n-1)7t/4 
TEA 


AUD; = To) e sin[(2n — 1)x/2 
13. u(,t) =T + 0) Y HR Del ] a? m-1?*t/4 


n=l 


4ho x4 1 2n — 1 2(2n — 1)?z?t 
iocus P Y sin i=) exp| a*(2n — 1)^n | 


17. u(x,t) = | 


E x sin(,) (£5) ( A) 
 B3[1 + Ksin2(B,)/hL] NL JN Be )? 
where Bn cece = dA 


n [sin(k,z) + 2a?k, cos(k,x)] _ 4242 
19. v(x, t) = 16a* ` (1 + 4a4h2)(1 4 4a? + m e^? Fat, and u(x,t) equals v(x, t) mul- 


tiplied by apie — TH /(4e2 )] and tan(k,) = 4a?k, / (4a*k2 — 1). 
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21. u(r,t) = 


ny sin(k,) — kn cos(kn) . (kyr ak t/o? 
: sin gf nS 
<= ka [2k — sin(2kn )] b 
where kn cot(Kk,, 3 —1-— A, nz < kn < (n4 1)m. 


EET 544 Sinh[(2n — 1)ry/2a] cos|(2n — 1)rz/2a] 
euge r 2 p (2n — 1)sinh[((2n — 1)7b/2a] 


cosh| € — 1)r(y — b)/2a] sin|(2n — 1)rx/2a] 
ED 2n — 1) cosh[(2n — 1)7b/2a] 


4 So m". — lr (x — a)/20] sin((2n — 1)xy/20] 
TJ (2n — 1) cosh[(2n — 1)ra/2b] 


27. u(x, y) 


n=1 


Section 12.1 


1. f(a) = +Po(z) + iP (£) a i5 P(x) Lee 3. f(x) = $Po(z) + $ Pr) == # Pa(z) Aes 


5. f(a) = $Pi() - 8P6) + PG) + 


17. y(z) 223? — 5 


19. u(r,0) = 100 
7a 


T Pisas toj] = , i Ps[cos(6)] — — (i P; eost] 


21. u(r,8) = Vy Y (P. [cos(a (a)] — Prsileos(a)}} (Z)" Paleos(6)] 
n=0 


Section 12.2 


Jı(2knva)Jolknr) . 
33. u(r, t) = vay, : E A ) sin(k,f) 


EN 2k, /a)Jo(2ks x) . 
or u(z, t) = vay Jka) sin(knt), 
where kn is the ili solution of Jo(2k) = 0. 


Jo(k LE 
k, Ji (k 


2 k2 
zi = Ht) , where Jo(kn) = 0 


35. u(r,t) 2 0 + 2(1 D» » 


2Gb? CA Jolknr/b) 2 
37. u(r, t) = is A 26 > IL. ar/b) ew(- vn ) , with Jo(kn) = 0 
39. u(r, t) t) = 7h e t 2 = bJ1 (kn b)\Jo(kn r) atk 


zr nL) + Jes Ly] 


with kn Jı (kn L) = ms ) 
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Aa?z | 24a q* sinh(k,z) Jı (kna) Jo(knr) 


43. = I 
deser currum Z^  Kicosh(k,L)Jg (ks) 


with J,(k,b) = 0 


45. u(r, z) = (= h)ro + 2ro Y sinh[k, (2 2 h)/a|Ji(knro/a)Jo(knr/a) 


KZ cosh(knh/a)J2(Rn) wae 0 


n=1 


4 & I [(2n — 1)rr/2] sin((2n — 1)r(z — 1)/2 

47. For case (a), u(r, z) = = > TR — a sin|( Unt: )/2] 
= cosh(knz) Ji(knr) 
2.5 ay tie) 


For case (b), u(r, z) = with Jı (kn) — 0 


2 (-1)" fa (nr) sin(nnz) 
49. 
u(r,2) = 25€ 


= n I (nva) 


sinh(knz)Jı (knr) —. = 
51. u(r, z) = D» KS cosh d with kyJo(kn) = Ji(kn) 


= Jultin)Jolsnr/a) _coshljin(L — 2)/al 
Value iras True Tra IET TENUES 


h(k kind kn ] 
55. u(r,z) — vh: ay se A( zr ew( 95 )«( 3 if |z| < d/2, 
1( 
and 
u sinh{k,d/( = knlz] knr\. 
= -vY EAT exp " Jo 2 if |z| > d/2 


57. u(r,z) = 2B Y: Bled ee mu EE with ky, Ja (kj) 


with pinJi (un) = bJolun) 


= BJo(Kn) 


n=1 


Taylor & Francis 
Taylor & Francis Group 
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abscissa of convergence, 296 
Adams-Bashforth method, 40 
addition 
of matrices, 102 
of vectors, 147 
age of the earth, 289-290 
aliasing, 239-241 
amplitude spectrum, 251 
Archimedes’ principle, 186-187 
autonomous ordinary differential 
equation, 4, 50 
auxiliary equation, 52 


back substitution, 107, 118 
bandlimited Fourier transform, 255 
Bernoulli equation, 28-29 
Bessel 
equation of order n, 519-524 
function of the first kind, 521 
expansion in, 529-534 
function of the second kind, 521 
function, modified, 524 
recurrence formulas, 524—525 
Bessel, Friedrich Wilhelm, 520 
Biot number, 468 
boundary condition 
Cauchy, 351 
Dirichlet, 389 
Neumann, 389 


Robin, 390 
boundary-value problems, 48 


carrier frequency, 268 
Cauchy 
boundary condition, 351 
data, 351 
problem, 351 
centered finite differences, 373 
characteristic 
polynomial, 129 
equation, 52 
value, 129, 444 
vector, 129 
characteristic function, 444 
characteristics, 365 
chemical reaction, 12-13 
circular frequency, 60 
circulation, 161 
closed 
contour integral, 159 
surface integral, 165 
coefficient matrix, 117 
cofactor, 109 
column of a matrix, 102 
column vector, 105 
complementary error function, 301 
complementary solution of an 
ordinary differential equation, 68 
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complex matrix, 102 
components of a vector, 147 
compound interest, 9 
conformable 

for addition of matrices, 102 

for multiplication of matrices, 103 
conservative field, 161 
consistency in finite differencing 

for the heat equation, 410 

for the wave equation, 375 
consistent system of linear eqns, 116 
convergence 

of a Fourier integral, 251 

of finite difference solution 

for heat equation, 412 
for wave equation, 378 

of Fourier series, 191 
convolution theorem 

for Fourier transforms, 279—282 

for Laplace transforms, 324-327 
Coriolis force, 149 
Cramer's rule, 113 
Crank-Nicholson method, 414 
critical points, 33, 90 

stable, 33, 90 

stable node, 92 

unstable, 33, 91 
cross product, 148 
curl, 156 
curve, space, 148 


d’Alembert’s formula, 367 
d’Alembert’s solution, 365-370 
d’Alembert, Jean Le Rond, 365 
damped harmonic motion, 63 
damping constant, 63 
degenerate eigenvalue problem, 453 
del operator, 150 
delay differential equation, 340—341 
delta function, 252-255, 304-306 
design of film projectors, 321-324 
design of wind vane, 66-67 
determinant, 109-112 
diagonal, principal, 102 
differential equations 

nth order, 47-97 

linear first-order, 1—46 

nonlinear, 1 

order, 1 
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ordinary, 1-100 
partial, 1, 407 
type, 1 
differentiation of a Fourier series, 202 
diffusivity, 388 
dimension of a vector space, 130 
direction fields, 31 
Dirichlet conditions, 192 
Dirichlet problem, 389 
Dirichlet, Peter Gustav Lejeune, 193 
dispersion, 358 
divergence 
of a vector, 155 
theorem, 181-187 
dot product, 148 
double Fourier series, 431 
Duhamel's theorem 
for the heat eqn, 405-408, 471—477 


eigenfunctions, 444—478 
expansion in, 461 
orthogonality of, 458 
eigenvalue(s) 
of a matrix, 129 
of a Sturm-Liouville problem, 444—453 
eigenvalue problem, 129-132, 376-377 
for ordinary differential eqns, 444—453 
singular, 444 
eigenvectors, 129-132, 376-371 
orthogonality of, 457 
electrical circuits, 24, 78, 335—340 
electrostatic potential, 547 
element of a matrix, 102 
elementary row operations, 116 
elliptic partial differential equation, 419 
equilibrium points, 33, 90 
equilibrium systems of linear eqns, 116 
error function, 301 
Euler's method, 34-37 
Euler-Cauchy equation, 85-88 
exact ordinary differential equation, 17 
existence of ordinary differential eqns 
nth-order, 48 
first-order, 8 
explicit numerical methods 
for the heat equation, 410 
for the wave equation, 372-373 
exponential order, 296 


Index 


fast Fourier transform (FFT), 239 
filter, 242 
final-value theorem 
for Laplace transforms, 311 
finite difference approximation 
to derivatives, 372-373 
finite Fourier series, 232-242 
first-order ordinary differential eqns, 1-46 
linear, 20-31 
flux lines, 152 
folding frequency, 241 
forced harmonic motion, 73-77 
Fourier 
coefficients, 190 
cosine series, 196 
cosine transform, 291 
Joseph, 192 
number, 395 
series for a multivariable function, 224 
series for an even function, 196 
series for an odd function, 197 
series in amplitude/phase form, 216-219 
series on [—L, L], 190-201 
sine series, 197 
sine transform, 291 
Fourier coefficients, 462 
Fourier cosine series, 196 
Fourier transform, 249-285 
basic properties of, 264—274 
convolution, 279—282 
inverse of, 250, 275-276 
method of solving heat eqn, 287-292 
of a Bessel function, 254 
of a constant, 262 
of a derivative, 267 
of a multivariable function, 255 
of a sign function, 263 
of a step function, 263 
Fourier-Bessel 
coefficients, 530 
expansions, 529 
Fourier-Legendre 
coefficients, 502 
expansion, 502 
Fredholm integral eqn, 126 
free underdamped motion, 60 
frequency convolution, 282 
frequency modulation, 270 
frequency spectrum, 252 
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function 
even extension of, 211 
generalized, 306 
odd extension of, 211 
vector-valued, 150 
fundamental of a Fourier series, 190 


Gauss's divergence theorem, 181-187 
Gauss, Carl Friedrich, 182 
Gauss-Jordan elimination, 119 
Gauss-Seidel method, 434 
general solution to an 

ordinary differential equation, 4 
generalized Fourier series, 462 
generalized functions, 306 
generating function 

for Legendre polynomials, 498 
Gibbs phenomenon, 206-208, 505 
gradient, 150 
graphical stability analysis, 33 
Green's lemma, 171-174 
grid point, 372 
groundwater flow, 422-426 


half-range expansions, 211-214 

Hankel transform, 554 

harmonic functions, 420 

harmonics of a Fourier series, 190 

heat conduction 
in a rotating satellite, 228-231 
within a metallic sphere, 510-516 

heat equation, 227-292, 387—416, 

465—484, 538-562 

for a semi-infinite bar, 287-289 
for an infinite cylinder, 401, 538-541 
nonhomogeneous, 389 
one-dimensional, 390—393, 465 
within a solid sphere, 399—401, 538 

Heaviside 
expansion theorem, 317-324 
step function, 299-302 

Heaviside, Oliver, 300 

homogeneous 
ordinary differential eqns, 16-17, 47 
solution to ordinary differential eqn, 68 
system of linear eqns, 106 

hydraulic potential, 422 

hydrostatic equation, 8 

hyperbolic partial differential equation, 348 
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impulse function 
see (Dirac) delta function 
inconsistent system of linear eqns, 116 
indicial admittance for heat equation, 472 
inertia supercharging, 213 
initial 
-value problem, 47, 329-342 
conditions, 351 
initial-boundary-value problem, 389 
initial-value theorem 
for Laplace transforms, 310 
inner product, 103 
integral curves, 90 
integrals, line, 158-162 
integrating factor, 19 
integration of a Fourier series, 203-205 
interest rate, 9 
inverse 
discrete Fourier transform, 233-235 
Fourier transform, 250, 275-276 
Laplace transform, 317—324 
inverse formula for Fourier transform, 250 
inversion of Fourier transform 
by direct integration, 275-276 
by partial fraction, 276 
inversion of Laplace transform 
by convolution, 324 
by partial fractions, 317-319 
in amplitude/phase form, 320-324 
irrotational, 156 
isoclines, 31 
iterative methods 
Gauss-Seidel, 434 
successive over-relaxation, 436 


Kirchhoff's law, 24 
Klein-Gordon equation, 358 
Kutta, Martin Wilhelm, 39 


Laplace integral, 295 

Laplace transform, 295-342 
basic properties of, 307-313 
convolution for, 324-327 
definition of, 295 
derivative of, 310 
in solving delay differential 

equation, 340—341 

integration of, 310 


inverse of, 317—324 
of derivatives, 298 
of periodic functions, 315-317 
of the delta function, 304-306 
of the step function, 299-302 
solving of ordinary 
differential eqns, 329-342 
Laplace's eqn, 286-287, 419—438, 484, 
508-519, 547—567 
in cylindrical coordinates, 420 
in spherical coordinates, 421 
numerical solution of, 433—438 
solution by separation 
of variables, 422-427, 508-516, 
547-554 
solution on a half-plane, 285-287 
Laplace’s expansion in cofactors, 109 
Laplace, Pierre-Simon, 421 
Laplacian, 155 
Lax-Wendroff scheme, 381 
Legendre polynomial, 497 
expansion in, 502 
generating function for, 498 
orthogonality of, 501 
recurrence formulas, 499 
Legendre’s differential equation, 495 
Legendre, Adrien-Marie, 495 
length of a vector, 147 
line integral, 158-162 
line spectrum, 218-222 
linear dependence 
of eigenvectors, 129 
of functions, 55 
linear Fredholm integral equation, 505 
linear transformation, 107 
linearity 
of Fourier transform, 264 
of Laplace transform, 297 
lines of force, 152 
Liouville, Joseph, 446 
logistic equation, 12 
LU decomposition, 127 


magnitude of a vector, 147 
matrices 
addition of, 102 
equal, 102 
multiplication, 103 
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matrix, 101 

algebra, 101 

amplification, 376-377 

augmented, 117 

banded, 106 

coefficient, 117 

complex, 102 

diagonalization, 134 

exponential, 141 

identity, 102 

inverse, 104 

invertible, 104 

method of stability 

of a numerical scheme, 376 

nonsingular, 104 

null, 102 

null space, 124 

orthogonal, 128 

real, 102 

rectangular, 102 

square, 102 

symmetric, 102 

tridiagonal, 106 

unit, 102 

upper triangular, 106 

vector space, 105 

zero, 102 
maximum principle, 420 
Maxwell’s field eqns, 158 
mechanical filter, 324 
method of partial fractions 

for Fourier transform, 276 

for Laplace transform, 317—324 
method of undetermined coefficients, 69-72 
minor, 110 
mixed-boundary-value problems, 440-442 
modified Bessel function, 

first kind, 524 

second kind, 524 
modified Euler method, 34-37 
modulation, 268-271 
multiplication of matrices, 103 


nabla operator, 150 

natural vibrations, 357 

Neumann problem, 389 

Neumann's Bessel function of order n, 522 
Newton's law of cooling, 467 

non-local boundary conditions, 417 


nondivergent, 155 
nonhomogeneous 
heat equation, 389 


ordinary differential equation, 47 


system of linear eqns, 106 
norm of a vector, 105, 147 
normal differential equation, 47 
normal mode, 357 
normal to a surface, 150 
null space, 124 
numerical solution 

of heat equation, 409—416 


of Laplace's equation, 433-438 
of the wave equation, 372—382 


Nyquist frequency, 241 
Nyquist sampling criteria, 239 


one-sided finite difference, 373 
order of a matrix, 102 
orthogonal matrix, 128 
orthogonality, 458 
of eigenfunctions, 457—460 
of eigenvectors, 457 
orthonormal eigenfunction, 460 
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overdamped ordinary differential eqn, 64 
overdetermined system of linear eqns, 121 


parabolic partial differential eqn, 388 


Parseval’s equality, 205-206 
Parseval’s identity 
for Fourier series, 205 


for Fourier transform, 271-272 


partial fraction expansion 
for Fourier transform, 276 


for Laplace transform, 317-324 


particular solution to ordinary 


differential equation, 3—4, 68 


path in line integrals, 159 


path independence in line integrals, 161 


phase 


angle in Fourier series, 216-219 


diagram, 89 
line, 33 
path, 90 
spectrum, 251 
pivot, 117 
pivotal row, 117 
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Poisson's 
equation, 429—431 
integral formula 
for a circular disk, 426-427 
for a upper half-plane, 287 
summation formula, 272-275 
Poisson, Siméon-Denis, 430 
population growth and decay, 11 
position vector, 147 
potential flow theory, 157 
potential function, 163-164 
power content, 205 
power spectrum, 272 
principal diagonal, 102 
principle of linear superposition, 52, 354 


QR decomposition, 128 
quieting snow tires, 197—201 


radiation condition, 351, 467 

rank of a matrix, 119 

real matrix, 102 

rectangular matrix, 102 

recurrence relation 
for Bessel functions, 524—525 
for Legendre polynomial, 499—502 
in finite differencing, 94 

reduced row echelon, 119 

reduction in order, 49 

regular Sturm-Liouville problem, 444 

relaxation methods, 434—438 

resonance, 77, 226, 332 

rest points, 33 

Robin problem, 390 

Rodrigues's formula, 498 

row echelon form, 118 

row vector, 105 

rows of a matrix, 102 

Runge, Carl, 38 

Runge-Kutta method, 37—40, 95-100 


Saulyev's method, 415-416 

scalar, 147 

Schwarz's integral formula, 287 

second shifting theorem, 301 

secular term, 226 

separation of variables 

for heat equation, 390-401, 465-471, 

538-547 


for Laplace’s equation, 422-427, 
508-516, 547—554 
for ordinary differential eqns, 4-14 
for Poisson’s equation, 429-431 
for wave equation, 351—362, 536-538 
shifting 
in the w variable, 268 
in the s variable, 307 
in the £ variable, 264, 308 
sifting property, 253 
simple eigenvalue, 447 
simple harmonic motion, 60, 331 
simple harmonic oscillator, 59-63 
sinc function, 251 
singular 


solutions to ordinary differential eqns, 6 


Sturm-Liouville problem, 444 
singular Sturm-Liouville problem, 444 
singular value decomposition, 135 
slope field, 31 
solenoidal, 155 
solution curve, 31 
solution of ordinary differential eqns 

by Fourier series, 225-231 

by Fourier transform, 283-285 
space curve, 148 
spectral radius, 129 
spectrum of a matrix, 129 
square matrix, 102 
stability of numerical methods 

by Fourier method for heat eqn, 411 

by Fourier method for wave eqn, 376 

by matrix method for wave eqn, 376 
steady-state heat equation, 10, 394 
steady-state output, 33 
steady-state solution to ordinary 

differential eqns, 75 
step function, 299-302 
Stokes’ theorem, 174—180 
Stokes, Sir George Gabriel, 175 
streamlines, 152 
Sturm, Charles-Frangois, 445 
Sturm-Liouville 

equation, 444 

problem, 444—453 
subtraction 

of matrices, 102 

of vectors, 147 
successive over-relaxation, 434 
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superposition integral 
of heat equation, 405-408, 471-477 
superposition principle, 354 
surface conductance, 467 
surface integral, 164—170 
system of linear 
differential eqns, 136-140 
homogeneous eqns, 106 
nonhomogeneous eqns, 106 


tangent vector, 148 
telegraph equation, 360 
terminal velocity, 9, 27 
thermal conductivity, 388 
threadline equation, 350-351 
time shifting, 264-265, 307 
trace, 102 
trajectories, 90 
transform 
Fourier, 249—285 
Laplace, 295-342 
transient solution to ordinary 
differential equations, 75 
transpose of a matrix, 104 
tridiagonal matrix, solution of, 106-107 


underdamped, 64 


underdetermined system of linear eqns, 118 


uniformitarianism, 290 
uniqueness of ordinary differential eqns 
nth-order, 48 
first-order, 3 
unit 
normal, 151 
step function, 299-302 
vector, 147 


Vandermonde's determinant, 113 
variation of parameters, 80-85 
vector, 105, 147 

vector element of area, 167 
vector space, 105, 130 

vibrating string, 348-350 
vibrating threadline, 350-351 
vibration of floating body, 62 
volume integral, 181-187 


wave equation, 347—382, 479, 535-538 
damped, 359-362 
for a circular membrane, 535—538 
for an infinite domain, 365—371 
one-dimensional, 350 

weight function, 458 

Wronskian, 56 


zero vector, 147 


